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ABSTRACT 

Conditions  are  prescribed  for  a  function  g  which  are 
sufficient  to  ensure  that  it  is  the  Radon  transform  of  a  continuous 

function  f  on  Rn  such  that  t(x)  »  0(  |x|  )  as  |xj  — ►  «•  . 

Roughly  speaking,  these  criteria  involve  smoothness  and  the  classical 
polynomial  consistency  conditions  up  to  order  k  on  g  .  In 
particular,  the  result  implies  Helgason's  Schwartz  theorem  for  the 
Radon  transform  [Acta  Math.  113,  I960]. 
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i.  introduction 


The  Radon  transform  of  an  integrable  function  f  on  Rn  is 
defined  by 


*,m> 


I 

J  <X,0  >  =»t 


f(x)dx  . 


Here  0  is  a  direction,  i.e.,  a  point  on  the  unit  sphere  Sn  1  ,  t 
is  a  real  number  and  the  integral  is  over  the  hyperplane  orthogonal 
to  0  and  passing  a  directed  distance  t  from  the  origin.  We 
address  the  questions  of  when  a  given  function  g  on  Sn_1xR  is  the 
Radon  transform  of  a  function  f  and  what  regularity  and  decay 
conditions  on  f  can  be  deduced  from  those  of  g  .  The  fundamental 
result  on  this  quesiton  is  due  to  Helgason  [3].  His  theorem  says 
that  an  even  function  g  in  the  Schwartz  space  S(Sn-1xR)  is  the 
Radon  transform  of  a  function  f  in  the  Schwartz  space  S(Rn)  if 
and  only  if 


(1.1) 


OO 

L 


g(* , t ) tJdt  = 


pj(f) 


j  =  0,1 


is  representable  as  a  homogeneous  polynomial  of  degree  j  in  0 

He  also  showed  that  under  the  above  hypotheses  f  has  compact 

support  if  and  only  if  g  does  and  that  the  convex  hull  of  the 

support  of  f  is  determined  by  the  support  of  g  .  The  first  result 

is  called  the  Schwartz  theorem  for  the  Radon  transform  and  the  second 

2 

the  Paley-Wiener  theorem  for  the  Radon  transform  [4],  An  L 


1 


version  of  the  Paley-Wiener  theorem  for  the  Radon  transform  was 
obtained  by  Lax  and  Phillips  [6].  Smith  et .  al .  [9]  showed  that  any 
even  function  in  the  Sobolev  space  Hs(Sn~1xR)  ,  s  =  (n-l)/2  ,  is  in 
the  range  of  the  closure  R  of  the  Radon  transform  as  an  unbounded 
operator  on  L^(Rn)  ,  but  that  R  is  not  necessarily  defined  by  an 
absolutely  convergent  integral.  Recently,  Solmon  [10]  showed  that 
any  even  g  in  S  ( Sn  1xl? )  is  the  Radon  transform  of  a  C°°  function 
f  such  that  f(x)  =0(|x|  n)  as  |x|  — *  »  ,  and  that 
f(x)  =  0(|x|  n  k_1)  if  and  only  if  (1.1)  holds  for 
j  =  0,1 . k  . 

In  this  paper  we  show  that  a  sufficiently  smooth  even  function 
on  Sn  ^xR  which  together  with  a  finite  number  of  derivatives  decays 
sufficiently  fast  at  <»  is  the  Radon  transform  of  a  continuous 
function  f  that  is  0(|x|~n)  as  |x|  — ►  «®  ,  and  show  how 
satisfying  a  finite  number  of  the  conditions  (1.1)  influences  the 
behavior  of  f  at  »  .  (Of  course  precise  conditions  on  the 
smoothness  and  decay  are  given.)  In  particular,  the  result  given 
here  implies  the  Schwartz  theorem  of  Helgason  and  the  recent 
extension  by  Solmon.  Our  proof  is  based  on  a  result  on  the 
asymptotic  behavior  of  the  Fourier  transform  due  to  Madych  [7], 
rather  than  the  Radon  inversion  formula  as  in  [10].  This  approach  is 
independent  of  dimension,  shorter  and  simpler  than  that  in  [10]. 
Moreover,  the  theorem  given  here  is  more  general. 
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2.  Operators  and  Egomlaa 


Let  9  be  a  point  on  the  unit  sphere  S  in  R  ,  n  >  2  , 

and  t  be  a  real  number.  The  Radon  transform  of  an  integrable 
function  f  on  Rn  in  the  direction  9  at  the  point  t  is  the 
function 

<2'11  ■  V“>  -  . 

where  <  ,  >  denotes  the  usual  Euclidean  inner  product  on  Rn  and 

dx  represents  integration  with  respect  to  n-1  dimensional  Lebesgue 
measure  on  the  hyperplane  <x,9>  =  t  . 

The  Fourier  transform  of  an  integrable  function  f  on  Rn  is 
defined  by 


f({)  =  (2x)~n//2  J  f (x)e”1<x,C>dx  , 

where  the  integral  is  taken  over  all  of  Rn  .  Fixing  9  in  (2.1) 
and  taking  the  one  dimensional  Fourier  transform  gives  the  well  known 
formula 

(2.2)  (*#ff  (r)  *  (27i)(n-1)/2f(rO)  . 

The  operator  A  is  defined  in  terms  of  Fourier  transforms  by 

(2.3)  (/iff(t)  -  |C|*U)  , 

2 

so  that  A  m  -  a  ,  where  4  is  the  Laplacean.  We  shall  also  use 
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the  Calderon-Zygmund  representation  of  A,  [l]. 


(2.4) 


't  -  1 


n 


3-1 


Vj  • 


where  denotes  partial  differentiation  with  respect  to  the  j-th 

coordinate  and  K j  is  the  singular  integral  operator  defined  by 

convolution  with  the  kernel  c  x./|x|n+1  ,  c  a  constant  depending 

n  j  1  1  n 

only  on  n  ;  i.e.,  * j  is  the  j-th  Riesz  transform. 

The  dual  Radon  transform  is  the  formal  adjoint  of  the  Radon 
transform  and  is  defined  on  functions  on  Sn-1xR  by 


(2.5) 


Rtg(x)  »  f  g(«,<x.a>)d® 
J„n-1 


The  Radon  transform,  dual  Radon  transform,  and  Calderon-Zygmund 
operator  are  related  by  the  Radon  inversion  formula 


(2.6) 


f  -  2~1(2n)1'n/ln"1i?t«f 


Remark  2.7.  If  f  €  L*tR  )  ,  1  <  p  <  n/(n-l)  ,  then  for  almost  every 
9,  ft0f(t)  exists  for  almost  every  t  and  for  a.e.  9  (2.2)  is 
valid  for  a.e.  r  .  Also  (2.6)  holds  almost  everywhere  on  Rn  . 

See  [10]. 


We  use  the  standard  multi-index  notation.  Thus  if  u  is  a 
multi-index  l.e.  an  n-tuple  of  nonnegative  integers,  x  e  Rn  ,  and 

V  V 

D  »  (D, ,  . . .  ,D  )  ,  then  xv  -  x/.-.x"  ,  Dv  is  the  differential 
in  in 
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I  n  1 

operator  D  .  ..D  ,  and  lul  ■  !*+•■•+*/  .  Also,  denotes  a 

in  'in  “ 

n-2 

j-th  order  (tangential)  differential  operator  on  the  sphere  S 
with  smooth  coefficients  and  g^^(<f,t)  denotes  the  j-th  order 
partial  derivative  of  g(9  ,t)  with  respect  to  t  . 

A  function  f  on  Rn  will  be  said  to  be  0(|x|  m)  as 
jx|  — *  «®  if  there  exist  constants  C,  M  >  0  such  that 
|f(x)|  <  C|x|-m  whenever  |x|  >  M  .  The  analogous  definition  is 
taken  for  the  statements  f  (x)  **  0{  |x|  m)  as  |x|  — »  0  ,  and 
g(0,t)  =  0  (  |  1 1  — m )  as  |tj  — ►  <»  or  0  . 

The  proof  of  the  theorem  on  the  range  of  the  Radon  transform  is 
based  on  the  following  asymptotic  result  about  Fourier  transforms 
which  is  a  straightforward  generalization  of  [7,  Proposition  5]. 


;  Let  f  be  a  function  on  Rn  such  that  f  is  integrable. 
Suppose  that  a  >  0  ,  m  is  an  integer  satisfying  m  >  n  +  a  ,  and 
that 

(i)  (fl^fU)  is  in  Cra(Rn\{0))  ,  and 

(il)  |{|^Dw(|t|  a  f(t))  is  bounded  on  Rn  for  all  v  such  that 
0  <  \v  |  <  m  . 

Then  f  is  continuous  and  f(x)  *  0(|x|-n-a)  as  |x|  — »  «•  . 

Proof ;  Since  f  is  in  ,  f  is  continuous  and  bounded  and  it 

suffices  to  show  that 

(2.8)  |  f  (x)  |  <  Clxf"-01  if  |  x  |  >  1  . 

To  see  (2.8)  let  |x|  >  1  ,  set  r  ■  |x|  ,  x*  ■  x/r  ,  and  write 
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f(x)  -  <2n)“n/2  J  |C  |ah(e  )ei<x,c>dc 


<2n)_n/2r_n"a  |  |{ |ah(t/r)ei<x' 'C>d?  , 


where  h(f  )  =  If)  a  f  (e  )  . 


The  last  formula  Indicates  that  to  verify  (2.8)  it  suffices  to 

show  that  the  Fourier  transform  of  h  (t )  =  It |a  h(f/r)  is  bounded 

r  1  1 

on  the  unit  sphere  independent  of  r  >  1  . 

To  see  this  let  t  be  a  function  in  C0*^11)  such  that 
P(C)  =  1  for  | c |  <1  and  *{t)  =0  for  |?|  >  2  and  write 

hr  »  hQ  +  h^  where  hQ(t)  =  hr(C)r(t)  and  h^U  )  =  hr (t  )  (  1-*  (t  )  )  • 
Since  nhgi^  is  bounded  independent  of  r  it  follows  that  hQ(x) 
is  bounded  for  all  x  and  hence  is  certainly  bounded  on  the  unit 
sphere.  To  obtain  a  similar  conclusion  concerning  h^  write 


(2.9)  )  »  A(t  )  +  B(C)  . 

where  A(t)  =5  c  ,.  | 1  |a~  ^  ^  Du~fJh[  t  /r )  r~  I  V~(J  I  ( 1-r  ( t  )  )  ,  the  c  1  s  are 
appropriate  constants,  and  the  sum  is  taken  over  all  multi- indices  ft 
such  that  0  <  ft  <  v  .  B(t)  is  a  similar  expression  except  that 
each  term  contains  a  derivative  of  (1-F)  of  order  one  or  higher. 
Observe  that 


|t  /Dr-l*'-"!  -  |t|a-|‘'l[|t/r|M-MD-f'h(t/r] 


and  the  expression  in  parenthesis  is  bounded  by  virtue  of  statement 
(11)  in  the  hypothesis.  Thus 
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(2.10)  | a(c )|  <  c|e \a~\v\ ( i -y { € ) )  . 

A  similar  observation  shows  that  B  is  supported  in  1  <  |t|  <  2 
and  is  bounded.  These  facts  concerning  A  and  B  imply  that 

(2.11)  iD^h^nl  <  Cje  Ja"M  {i-r  (2f ) )  . 

Now,  if  \u\  =  m  ,  recalling  that  a  is  greater  than  n  +  a  , 
it  follows  from  (2.11)  that  ifD^hJij  is  bounded  independent  of  r  . 
Since  this  is  true  for  all  such  v  ,  we  may  conclude  that 
||x|m  h  (x)  |  is  bounded  independent  of  r  and  hence  h^  is  bounded 
on  the  unit  sphere.  This  implies  the  desired  result.  0 


It  is  convenient  to  introduce  the  following  definition. 


Definition.  A  function  g  on  S°  is  said  to  be  uniformly 

integrable  if  there  exists  an  integrable  function  h  on  R  such 

that  |g(e , t) j  <  h(t)  for  all  9  and  t  . 


The  range  theorem  follows. 

Theorem .  Let  g  «  Cr(Sn~*x*)  ,  where  r  >  m  »  n+2+le  ,k  >  -1  . 
Assume  g(-«,-t)  ■  g(9 ,t)  , 
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(3.1)  ^k+l+q^j  g^*^(9,t)  is  uniformly  intograble  for 
j  =  0,1,..., m-q  ,  and  q  =  0,1,..., n+1;  and 

O© 

(3.2)  g(9,t)t  dt  *  P. (9)  is  representable  as  a  homogeneous 
J  —00 

polynomial  of  degree  t  for  t  =  0,1,..., k  . 

Then  there  exists  a  function  f  in  Cs(Rn)  ,  (s  =  r+l-n  ,  n  odd  and 
s  =  r-n  ,  n  even)  ,  such  that  f(x)  =  0(  |  x| )  as  |x|  _  »  and 
Rt ( 9 , t )  »  g(9,t)  for  all  9  and  t  .  Moreover ,  for  each  x  e  Rn 
the  inversion  formula 

(3.3)  f(x)  =  2_1(2n)1_n  An~1Rtg(x) 

holds  . 


Remark .  When  k  *  -1  ,  (3.2)  Is  taken  to  be  vacuous. 

Proof .  The  continuity  of  g  and  (3.1)  with  q  =  j  *  0  imply  that 
g  is  uniformly  integrable.  Thus,  the  function  f  defined  in  polar 
coordinates  on  Rn  by 

(3.4)  f(r9)  »  (2n)(1_n)/2  gg(r)  -  (2n)'n/2  [  g(9 , t)e~ 1 trdt 

is  bounded  on  Rn  and  continuous  on  •* n—  < 0 )  .  We  show  that  f 
satisfies  the  hypotheses  of  the  Lemma  with  a  -  k+1  .  Leibnitz 
formula  gives 
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(3.5) 


n+1 


tk+l+qg(q) 


(d/dt)n+1(tmg)  =  2 

q=0 


cm,k 


with  the  c  .  known  constants.  By  (3.1)  each  term  on  the  right 
m  /  k 

hand  side  of  (3.5)  is  uni formally  integrable  and  hence  so  is  the  left 

hand  side.  Since  g^n+1^  is  continuous,  solving  for  g^n+1^  in 

(n+1)  " 

(3.5)  shows  that  g  'is  uniformly  Integrable.  Thus  g  is 

continuous  on  Sn-1xR  and  uniformly  0(r_n_1)  as  r  — ►  <»  .  This, 
(3.4),  and  the  fact  that  f  is  bounded  imply  that  f  is  Integrable 
and  hence  its  inverse  Fourier  transform  f  ,  is  continuous. 

We  will  show  at  the  end  of  the  proof  that  the  polynomial 
condition  (3.2)  can  be  replaced  by 

oo 

(3.6)  [  g(«,t)t*dt  *  0  ,  e  «  o.i . k  , 

without  loss  of  generality.  Accepting  this  for  now,  the  uniform 
integrability  assumption  of  (3.1)  allows  differentiation  under  the 
integral  sign  in  (3.6)  giving 

00 

(  g(«,t)t*  dt«  0  ,  t  -  0,1,..., k  ;  J  =  0,1,..., m  . 

J  —00 

U+  1  A 

Since  t  D~  g  is  uniformly  integrable,  the  above  and  Taylor’s 
theorem  give  that 

(3.7)  |  ( tpDj  gTo-)!  «  0(rk+1“p)  as  r  — ♦  o  ,  when  0  $  p  s  k+1  . 
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Let  0  <  |v|  <  m  =  n+2+k  .  By  (3.4),  in  polar  coordinates 
|{|lwlDP(|tjlelf)  is  a  sum  of  terras  of  the  form 

rf  (d/dr  )*  (r~^~*(Dg  gf(r«))  ,  t  -  0,1 . \u\  <  m, 

j  =  0 , 1 , . . . , |p | -t  .  This,  in  turn,  is  a  sum  of  terms  of  the  form 

(3.8)  r"k_1+p(tPD^  g)~(rfl ) ,  0  i  p  <  <  <  |u|  <  m  , 

where  the  Fourier  transform  is  in  the  sense  of  distributions  when 
p  >  k+1  .  If  0  <  p  <  k+1  ,  (3.7)  and  the  uniform  integrability 
assumption  (3.1)  show  that  terms  of  the  form  (3.8)  are  continuous  on 
*n-(0>  and  bounded  independent  of  9  .  Suppose 
ml  |y|  >  t  >  P  >  k+i  .  Leibnitz  formula  shows  that 
(d/dt)p_k  1(tpD^g)  is  a  sum  of  terms  of  the  form  tk+1+qDjj  g^q*  , 

q  =  0,1 . p-k-1  .  Each  such  term  is  uniformly  integrable  by  (3.1). 

Thus  (tpD^  g )~(t9)  Is  continuous  on  r  >  0  and  uniformly 
0(rk+l  Pj  as  r  — t  «»  an<J  o  .  Hence  (3.8)  is  bounded  in  this  case 
also.  The  Lemma  now  implies  that  f(x)  *  0(|x|  )  as 

M  — ’  •  • 

Since  f  is  continuous  and  0(|x|-n)  as  |x|  — ►  «>  ,  Rf  is 
continuous  also.  Moreover  f  «  Lp(Rn)  for  all  p  >  1  .  By  Remark 
(2.7),  (2.2)  holds  a.e.  This,  together  with  (3.4),  shows  that 
Rf  ■  g  a.e.  and  thus,  by  continuity,  everywhere.  Again  Remark  (2.7) 
gives  that  the  Inversion  formula  (2.6),  and  hence  (3.3),  holds  a.e. 

To  show  that  it  holds  everywhere  it  suffices  to  show  that  the  right 
hand  side  of  (3.3)  is  continuous.  Zf  n  is  odd,  then  (2.3),  (2.5) 
and  the  fact  that  g  <  Cr(Sn"*1xR)  show  that  the  right  hand  side  of 
(3.3),  and  hence  f  ,  is  C  If  n  is  even,  then  write 


1  ■  /i(A^n  2^2)  an<j  use  the  Calderon-Zygmund  representation  of 
A  ,  (2.4).  This,  together  with  the  fact  that  the  Riesz  transforms, 

,  reduce  differentiability  by  at  most  4  for  any  4  >  0  ,  shows 
that  the  right  hand  side  of  (3.3),  and  hence  f  ,  is  Cr-n  .  This 
completes  the  proof  of  the  Theorem  with  the  exception  of  showing 
that,  without  loss  of  generality,  (3.2)  can  be  replaced  by  (3.6).  To 
see  this,  note  that  by  [10,  Lemma  7.4],  there  exists  a  C°°  function 
h  vanishing  outside  of  the  unit  ball  in  Rn  such  that 

«© 

[  J?eh(t)t'  dt  =  P  (9)  ,  t  -  0.1 . k  , 

J  —<x> 

where  the  Pf  are  the  same  polynomials  as  those  that  appear  in 

(3.2) .  Replacing  g  by  g  -  Rh  does  not  effect  (3.1)  but  replaces 

(3.2)  by  (3.6),  and  f  by  f  -  h  which  has  no  effect  on  the 
smoothness  of  f  or  its  rate  of  decay  at  «»  .  The  proof  is 
complete. 


Remark .  The  proof  actually  shows  that  when  n  is  even  then  all 
partial  derivatives  of  f  or  order  r  -  n  satisfy  a  Hblder 
condition  of  order  a  for  any  a  <  1  .  Also,  it  follows  from  [9, 
Theorem  12.6]  that  the  classical  Radon  inversion  formula 
f  *  2-1  ( 2n  )_nR%n  1g  is  valid  everywhere. 

He  now  give  a  few  corollaries  of  the  Theorem. 

The  Schwartz  space  S(Sn  1xR)  consists  of  those  C**  functions 
on  Sn  1xR  which,  together  with  their  derivatives  of  all  orders, 
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decay  at  infinity  faster  than  the  reciprocal  of  any  polynomial 
in  t  . 

Corollary  1 .  [10].  Let  g  €  S(Sn_1xR)  and  suppose  that 

g(-*.-t)  =  g(«,t)  .  Then 

a)  g  *  Rf  for  some  C°*  function  t  such  that  f(x)  *  0(|x|“n) 
as  |x|  — ►  00  . 

b)  f  ( x )  «  0<  |X|  -n-fc-i)  if  an(j  only  if  (3  2)  holds  for 
t  =  0, 1 , . . . ,k  . 

c)  If  f  ( x)  =  0 {  |  x |  _m )  then  for  all  v  €  N11  , 

DU f ( x )  *  0(|x|-m-|H,  . 

Proof .  When  g  «  S(Sn  1xR)  ,  (3.1)  is  satisfied  for  all  choices  of 
j,  q  and  k  .  So  a)  and  b)  are  immediate  consequences  of  the 
Theorem.  To  see  that  c)  holds  observe  from  (2.2)  that 
RtfDyf  =  9V (Rg t ) l \u I  *  and  by  integration  by  parts  that  if  g  =  Rf 
satisfies  (3.2)  for  t  *  0,1,..., k  ,  then  ewg(lul)  satisfies  (3.2) 
for  e  »  0,i,...,|v|+k  ,  and  apply  b). 

Corollary  2.  Let  g  c  cn+1(Sn_1xR)  and  suppose  that 

g(-« ,-t)»g(* ,t)  .  Assume  that  (3.1)  Is  satisfied  with  k  *  -1  . 

Then  the  inversion  formula  for  R *  , 

(3.9)  g  -  2_1(2n)  1_nJ|/in"1Rtg  , 

holds  everywhere . 
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Proof .  By  the  Theorem  Rt  *  g  everywhere  with  f  given  by  (3.3). 


RMHirft  Inversion  formulas  for  R*  have  been  given  earlier  for 
functions  in  S(Sn-1xR)  .  Helgason  [3]  gave  an  inverison  formula 
when  (3.6)  is  satisfied  for  all  nonnegative  integers  t  Gonzalez 
[2]  and  Hertle  [5]  proved  that  (3.9)  holds  for  n  odd  and  Solmon 
[10]  showed  it  holds  in  all  dimensions. 

The  last  corollary  is  a  sort  of  Tauber lan  theorem. 

Corollary  3.  Let  g  €  Cn+2(Sn  *xR )  be  such  that  g(-9,-t)  =  g(9,t) 
Suppose  that  (3.1)  is  satisfied  for  k  *  0  .  Then  g  is  the  Radon 
transform  of  an  Integrable  function  f  If  and  only  If 

oo 

(3.10)  f  g(®  ,t)dt  ■*  c  , 

J  — OO 


where  c  is  a  constant .  independent  of  9  . 

Proof .  Since  the  hypotheses  of  the  Theorem  are  satisfied  with 
k  ■  0  ,  g  is  the  Radon  transform  of  a  continuous  function  that  is 
0(|xj-n~l)  as  } x }  — ♦  «*  ,  and  hence  of  an  integrable  function.  So 
the  condition  is  sufficient.  The  necessity  of  the  condition  is  an 
immediate  consequence  of  Fubini's  theorem. 

Rfinirlr  Peters  [8]  has  shown  that  the  Radon  transform  of  the 
function  f(x)  ■  ain( |x| 2 ) / ( |x| 2)  ,  in  the  plane,  is  0(|t|  2)  as 
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t  — ►  »  .  Since  f  Is  a  radial  function  its  Radon  transform  is 

independent  of  9  and  hence  so  is  f  J?f(9,t)dt  .  Nevertheless  f 

■*  —00 

2 

is  not  integrable  on  R  .  Hence  condition  (3.10)  is  not  sufficient 
by  itself  to  imply  the  lntegrabllity  of  f  . 
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Abstract:  A  theory  of  multivariate  splines  is  presented  which 
Includes  "Multiquadric"  surfaces.  It  is  essentially  an  extension 
of  Duchon's  theory,  but  this  development  completely  avoids  the  use 
of  Fourier  analysis.  More  precisely  we  consider  the  problem  of 
interpolating  numerical  data  at  a  finite  number  of  points  in  the 
plane  or,  more  generally,  in  n  space  by  interpolants  which  are 
essentially  linear  combinations  of  translates  of  a  prescribed 
function  h.  A  semi-norm,  minimized  by  such  interpolants  is  shown 
to  exist  if  and  only  if  h  is  conditionally  positive  definite. 
Pointwise  error  estimates  are  obtained  in  terms  of  this  semi-norm. 


1.  Both  authors  were  partially  supported  by  a  grant  from  Air 
Force  Office  of  Scientific  Research,  AFOSR  - 


86  -  0145. 


1 .  Introduction 


A  variety  of  methods  exist  for  fitting  an  interpolating 

surface  through  data  v  given  at  a  scattered  set  of 

2 

points  x1,...,  xN  in  the  plane  R  (or  higher  dimensional  space 
Rn) .  For  a  recent  survey  see  {7].  Two  methods  that  performed  quite 
well  in  comparative  numerical  tests  [6]  are:  Thin  Plate  Splines 
(TPS)  [8]  and  Multiquadric  Surfaces  (MQS)  [9].  A  rather 
complete  theory,  applicable  to  TPS,  but  not  MQS,  has  been  developed 
by  Duchon  [3]  -  [5];  also  see  [14].  Theoretical  results  about 
MQS  are  more  recent  and  less  complete,  [7],  [12],  [13]. 

In  [12]  an  extension  of  Duchon's  theory  was  developed  which 
Includes  MQS.  That  development  relies  heavily  on  Fourier 
analysis.  Here  we  present  refinements  of  those  results  which 
Include  error  estimates  and  avoid  the  use  of  Fourier  transforms. 

In  this  development  certain  features  of  Duchon's  theory  are 

preserved.  In  particular  the  interpolants  s(x)  ,  x  e  Rn,  can  be 

characterized  as  being  solutions  of  a  variational  problem  in  which 

a  translation  invariant  quadratic  functional  is  minimized  subject 

to  constraints  sfx^)  -  v^.  As  in  Duchon's  theory  the  quadratic 

functional  is  associated  with  a  Hilbert  space  norm  and  a 

2 

reproducing  kernel  K(x,y)  -  h(x-y).  For  TPS,  h(x)  ■  |x|  log|x| 

-  _ _  n 

and  for  MQS  ,  h(x)  -  -/a2*  jx  |4  .  Here  |x  | 2  -  £  (x^  2. 

k«l 
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Unlike  Duchon's  exposition,  where  the  choice  of  norm  takes 
precedence,  the  development  here  starts  with  the  function  h  and 
uses  it  to  define  an  appropriate  norm.  Another  difference  in  our 
results  is  that  we  do  not  require  any  sort  of  dilation  invariance. 


The  lnterpolants  s  are  expressible  in  terms  of  translates 
of  the  function  h.  In  the  simplest  case  (m*0,  below) 

N 

s (X)  *  ^  cj  h(x-Xj).  In  the  general  case  s  includes  a  polynomial 
3-1 

of  degree  less  than  some  fixed  integer  m  and  the  coefficients  c, 

N  J 

are  restricted  by  the  requirement  that  ^  c^  p(x^)  *  0  for  ail 

3=1 

polynomials  p  of  degree  not  exceeding  m-1.  Thus  we  have 

N 

(1.1)  s ( x )  *  £  Cj  hix-Xj)  +  £  ka  xa 


3=1 


|  a  |  <m 


where  the  constants  c^  and  ka  must  satisfy 


(1.1®) 


(1.1b) 


N 

1  cJh,x1-xj)  +  l  *a  -  vr  1-1 . N 

J»1  |a|<m 

N 

£  Cj  x^a  -  0  ,  |a| <m. 

3-1 


As  usual,  a  *  (a  ,...,an)  denotes  an  n-tuple  of  non-negative 

n  ak 

Integers,  lal  -  a  +...+a  and  xa  -  n  • 

1  **  U.1 
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For  the  case  of  Thin  Plate  Splines,  the  equations  (1.1)  have 
direct  physical  interpretations.  For  that  case,  h  is  as  mentioned 
above  and  m  is  2.  The  c^'s  are  proportional  to  forces  applied  at 
the  points  and  the  moment  conditions  (l.lb)  are  required  for 
equilibrium,  see  [9].  Analogous  interpretations  can  be  made  for 
cubic  splines  on  the  line;  there  n»l,  h(x)  =  |x|  and  m=*2 . 

It  is  useful  to  record  some  elementary  observations  about 
(1.1).  In  matrix  notation  we  have 

Ac  +  Bk  «  v 


Btc  =  0 

where  A  is  NxN  and  B  is  Nxm'  with  m' «=dim  P  .(Kn) 

m- 1 


(m-l+n) ! 


!  in- 1 )  !  n  I"  * 


Letting  Rg  denote  the  range  of  B 
that  c  is  in  Rg,  where  Rg  “  -fee  CN  : 


we  see  that  (l.lb)  says 
bT  c  =  0  for  all  be  *„} . 


Consequently,  (1.1)  will  have  a  solution  if  and  only  if  v  is  in 
A(Rg)  ♦  Rg.  Now  CN  -  A(Rg)  +  Rg  iff  Ac  e  R0  for  all 


ce  Rg  “  (0).  Furthermore,  Ac  e  Rg  ( =Rg'L )  Iff  wT  Ac  *  0  for  some 


Rg  .  Thus ,  (1.1)  can  be  solved  for  arbitrary  v  if  and  only  if 
for  every  ce  R^  “  ( 0 )  there  is  a  we  Rg  such  that  wT  Ac  *  0 . 

M 

In  addition  we  note  that  €  *  A(Rg)  +  requires 

dim  A(Rg)  ■  dim  Rg.  Hence,  if  (1.1)  can  be  solved  for  arbitrary  v 


then  c  in  (1.1)  is  unique . 


A  condition  that  is  sufficient  to  make  (1.1)  solvable  for 
all  v  is:  cT  Ac  >  0  for  all  ce  Rg  ~  (0).  This  condition  can  be 
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restated  as: 


for  all 


c  x  0 


N 

l  ~t  h(xrV 

i.3=i 

satisfying  ( 1 . lb)  . 


0 


The  last  Inequality  offers  motivation  for  (1.2)  in  the 
following  definition.  However,  the  true  motivation  for  (1.2)  is 
that  it  is  needed  (see  equation  (1.3)  below)  in  order  to  obtain 
our  variational  setting  for  the  interpolation  problem  (1.1). 


Definition:  If  h  is  a  continuous  function  from  Rn  to  f  then  h 
is  conditionally  positive  definite  of  order  m,  provided  that  for 
every  positive  integer  N, 


(1.2) 


l  si  cj  h|xi'V  *  0 

i.j=i 


holds  whenever  x1>a..,xN  are  distinct  points  in  Rn  and  c  ...,cN 
are  complex  numbers  that  satisfy  (1.1b).  We  define  to 

be  the  class  of  conditionally  positive  definite  functions  of  order 
„n 

m  on  R  . 

In  the  case  m=0  the  above  definition  reduces  to  the  usual 

definition  of  a  positive  definite  function.  Thus,  by  Bochner's 

theorem,  QQ(Rn)  is  the  set  whose  elements  are  Fourier  transforms 

of  finite  positive  Borel  measures.  For  m>0,  an  analogous 

characterization  of  the  functions  in  Q  (Rn)  Is  given  in 

m 

[8,  Chapter  II,  Section  4.4]. 

It  is  not  always  easy  to  determine  whether  a  given  continuous 
function  h  is  conditionally  positive  definite.  Often  the  most 
direct  method  is  to  calculate  the  (distributional)  Fourier 
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transform  of  h  and  check  whether  It  is  positive.  This  was  done 

for  several  examples,  including  h(x)  =  -  /  62+|x|2  ,in  [12]. 

In  the  case  that  h(x)  is  a  radial  function  the  task  of 
determining  whether  it  is  conditionally  positive  definite  can 
often  be  considerably  simplified  by  applying  Micchelli's 
generalization  [13]  of  Schoenberg's  theorem  [14]  concerning 
completely  monotone  functions.  This  result  can  be  stated  as 
follows:  If  F(t)  is  real  valued  and  continuous  for  t>0  then 

h(x)  *  F (  | x  j  2  )  is  in  Q  (lPn)  for  all  n  if  and  only  if 

m 

(-l)m+/  F(ra+€)  (t)  i  0  for  all  t  s  0  and  all  1  =  0,1,2 . 


Application  of  this  theorem  with  F(t)  =  t  log  t,  m  =  2,  and 


F(t) 


6  +t  ,  m  =  1,  provides  an  easy  verification  of  the 


conditional  positive  definiteness  of  h(x)  =  |x|  log|x|  and 


h(x) 


62+|x|2 


We  now  turn  our  attention  to  the  variational  setting  for  the 

interpolation  problem.  This  setting  is  the  space  Ch  described  by 

Theorem  1.1  below.  First  we  recall  some  notation. 

Let  P  , (Sn)  denote  the  space  consisting  of  polynomials  on  Rn 
m- 1 

_L  q 

of  degree  not  exceeding  m-1.  We  define  Pm_ (1R  )  to  be  space  of 

all  measures  v  on  !R n  that  have  support  consisting  of  a  finite 

number  of  points  and  satisfy  t>(p)  =  0  for  all  p  in  P  ,  (5?n)  . 

ra- 1 

N 

Note  that  v  ■  S  c.  f>  is  in  P__,  if  and  only  if  (1.1b) 

U  *  X  •  U*  A 

1  =  1  1 

is  satisfied.  Here  $x  is  the  measure  corresponding  to  a  unit  mass 
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at  the  point  x,  so  6  ( f )  =  f (x) .  In  Theorem  1.1  ^*h  denotes  the 
usual  convolution  product.  For  example,  6y*h(x)  =  h(x-y) . 

Theorem  1.1:  Given  miO  and  h  in  Q _ ( ER n>  there  is  a 

-  —  m  -  —  — 

subspace  Ch(Rn)  of  C(Rn),  with  a  semi-inner  product 
( • , . ) h,  such  that 

(a)  the  null-space  of  the  semi-  norm  is  P  .  (Rn), 

m— l 

(b)  C,  /P  .  is  a  Hilbert  space, 

n  m— l  —  —  -  — - 

(c)  if  v  is  in  P  \  (Rn)  then  u*h  is  in  C.  (Rn)  and 

la—  i  -  n 

(^*h,f)h  =  p(f)  for  all  f  in  Ch(Rn) 

Furthermore.  these  properties  uniquely  determine  C^(IRn)  and 
(  '  >h  ’ 

The  proof  of  Theroem  1.1  is  carried  out  in  section  3.  It 
includes  an  explicit  construction  of  the  subspace  Ch  which  does 
not  involve  Fourier  analysis.  On  the  other  hand,  except  for 
certain  special  examples  (see  below),  is  rather  awkward  to 

describe  without  this  basic  tool. 

The  results  in  Section  2  show  that  contains  interpolants 

of  the  data  v ,,..., v„  at  the  scattered  set  of  points  x . ,x„. 

IN  IN 

Moreover  it  is  also  shown  that  the  interpolant  of  the  form  (1.1) 

is  in  C.  with  minimum  C.  norm, 
n  n 

The  connection  with  reproducing  kernel  Hilbert  spaces  can  be 

seen  as  follows.  If  m«0,  we  can  take  in  part  (c)  of 

Theorem  1.1,  to  obtain 

f ( x )  -  (fi  *h,f).  =  (f,fi  *h). 

x  h  x  'h 

Thus,  K(x,y)  =  h(x-y)  is  a  reproducing  kernel  for  the  space 
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if  m*0 .  For  background  on  reproducing  kernels  and  positive 
definiteness  we  recommend  [2].  An  extended  notion  of  reproducing 
kernel  is  defined  in  [4]  and  [16];  in  essence.  Theorem  1.1  says 


that  K(x,y)  =  h(x-y)  is  such  a  kernel. 

The  necessity  of  (1.2)  can  be  seen  by  taking  v 

and  f  =  p*h  in  (c)  to  get 
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x 


i 


N  N  _ 

(1.3)  (p*h,^*h)h  -  ^  ci  y*h(x1 )  =  £  ci  h(x1-Xj)  . 

i=l  i . j=l 


We  conclude  this  section  with  several  examples  of  h  and 
corresponding  C^. 

A.  n-1,  ra-o,  h(  x)  »  e‘lXl,  Ch  =  (f  e  AC  n  L2(R)  :  f'  e  L2  (R  )  }  , 

(f'f)h  =  I  }{|f(*)|2  +  I f'  (X)|2}dx. 

R  ^ 


B.  n*l ,  m*l,  h( x)  *  - 1 X ( ,  Ch  =  { f  e  AC  :  f '  e  L2 (R ) } , 

(f.f)h  =  \  f  I*'  (x)|2  dx. 

R 


C.  Consider  the  cases  included  in  Duchon's  theory.  Example  B, 

but  not  A,  is  such  a  case.  Other  examples  include  interpolants  in 

Rn  which  satisfy  Ams(x)  ■  0  whenever  x  Is  in  Rn\ (Xj , . . . ,xN) 

r  k  2 

and  which  minimize  the  functional  (f,f)h  ■  I  |A  f(x)|  dx,  where 

Rn 


7 


Am  denotes  the  m-th  iterate  of  the  Laplace  operator,  m  must  be  an 

Jf 

integer  greater  than  n/2,  k=m/2,  and  A  is  suitably  interpreted  if 
1c  is  not  an  integer.  For  details  see  [41.  Here  h(x)  =  c|x|m  n 
or  c|x|ra  n  log|x|  depending  on  whether  n  is  odd  or  even;  c  is  a 
normalizing  constant  depending  only  on  m  and  n. 

2  2 

6  +  |x  |  is  in 

for  any  n.  In  this  case  the  space  and  the  corresponding 
quadratic  form  are  very  awkward  to  describe  without  the  use  of 
Fourier  transforms. 
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2 .  Variational  characterization  and  error  estimate . 

In  this  section  we  use  the  space  described  by  Theorem  1.1 
to  obtain  a  variational  formulation  of  the  interpolation  problem  we 
started  with.  We  also  look  at  certain  bounds  on  the  difference 
between  a  function  f  e  and  an  interpolant  s  that  matches  f  on  a 
set  of  points 

We  begin  with  the  question  of  whether  Ch  can  interpolate 
arbitrary  data. 

Proposition  2.1:  Fix  msO  and  h  .in  Qm(Rn)  •  Let  {x^f...,Xjj}  be 

a  finite  subset  of  R n .  The  -following  statements  are  equivalent : 

II 

( a )  For  every  v  in  C  there  is  an  f  in  C  h  that  satisfies 
f (xi>  =  vA ,  i»l, . . . ,N. 

N 

(b)  £  ^i  Cj  h(xj-xj,)  >  °'  every  (c1(...,cs)  *  0  that 
i,j  =  l 

satisfies  (1.1b), 

It 

(c)  (1.1)  can  be  solved  for  every  vino. 

Proof  :  To  see  that  (a)  implies  (b),  suppose  (b)  is  not  true. 

N 

Then  for  some  c1,...,cK  as  above  we  have  Y  cj  c.  Mx.-x^}  *  0. 
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From  (1.3)  we  see  that  (p*h,p*h).  =  0 

n 


where  v 


N 


I 


c  . 


l 


By  part  (c)  of  Theorem  1.1  this  implies  that  p(T) 


0  for  all  f  in 


N 

C^.  But  then  ^  Cj  f(x^)  -  0  and  it  is  impossible  to  have 
i  =  l 


f(x -  cA .  This  is  contrary  to  (a). 

That  (b)  implies  (c)  was  noted  in  the  introduction  (just 
before  the  definition  of  Q  ) . 


s 


If  c.  and  k 
1  a 

p*h  +  p  with 


solve  (1.1)  then  (1.1a)  says  . 

N 

M  IC1  6x,  ar,d  P'*1  •  l  ka  x“ 
1=1  | a | <m 


Here 

By 


1  n 

(1.1b),  v  is  in  P  ,  (!R  )  ,  so  s  is  in  the  space  C .  .  From  this  we 

m-i  n 

see  that  (c)  Implies  (a)  . 

The  next  result  shows  that  solutions  of  (1.1)  correspond  to 
interpolants  from  that  have  minimum  norm. 


Theorem  2.2:  Fix  ituO  and  h  in  Q  (Rn)  .  Given  v  =  (v,  ,...,v„)  in 

-  -  - -  jU  -  l  N - 

N  n 

C  and  distinct  points  Xj,...,xN  in  R  ,  let 

V  *  {f  e  ch  :  f(xA)  ■  v  1*1,..., N).  Then  V  is  non-empty  if  and 

only  if  there  are  constants  c  and  ka  that  satisfy  ( 1 . 1 )  .  In 

that  case 
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N 

(2.11  S(X)  -  I  c}  hlx-Xj)  *  l  x" 

j=l  | o I <m 

belongs  to  V  and  for  every  f  in  V 

(2.2)  "f"h  “  ilsllh  +  llf~slih- 

Proof:  Let  M  be  the  subspace  of  CN  that  is  orthogonal  to  the 

subspace  P  =  ( (plXj ) , . . . ,p(xN) )  :  p  e  P  (Rn)},  so  that  CN  =  M  ®  P. 

N 

For  c  in  CN  let  p  =  Y  c.  6  .  Note  that  c  e  M  iff  v  e  P  _L,  . 

c  L  i  x.  c  m-l 

i  =  l  1 

Suppose  V  is  not  empty.  Choose  f  in  V  and  let  v  *h  be  the 

o  o 

orthogonal  projection  of  fQ  onto  the  subspace  W  =  {^c*h  :  c  e  M) . 

Then  (w,fQ-  p^*h ) ^  =  0  for  all  w  in  W.  Equivalently,  for  all  c  in  M, 

(^c*h,  gQ)h  *  0  where  gQ  =  fo-pQ*h.  By  part  (c)  of  Theorem  1.1, 

N 

^  Cj  g^x^)  *  0  for  a11  c  in  M.  Since  P  =  m"*"  there  must  be  a 
1-1 

polynomial  p  in  Pm  ,  such  that  g  (x.)  -  p(x.)  for  i=l . N.  Thus, 

m-l  O  1  1 

the  function  8  -  p  *h+p  satisfies  s(x.)  -  f  (x.  )  «  v.  ,  i*l . N. 

o  loll 

From  this  it  is  seen  that  a  solution  of  (1.1)  is  provided  by  the 

coefficients  associated  with  p  and  p. 

o 

Conversely,  if  (1.1)  admits  a  solution  then  V  *  0  since  the 


11 


function  given  by  (2.1)  will  be  in  V.  To  establish  (2.2)  we  need 

only  show  that  (s,f-s)^  =0.  As  noted  in  the  previous  proof, 

s  »  p*h+p  with  v  in  P_"L,  and  p  in  P  By  Theorem  1.1, 

m- 1  id—  l 


and 

Now  P(f)  *  P(8) 
(s,f-s)h  «=  0. 


(s, f )h  *  (p*h, f )h  *  v  (?) 

(s,s)h  =  (t>*h,s)h  »  *•>(!) . 
because  f(xA)  =  s(xi),  for  i=l 


N .  Hence 


For  the  remainder  of  this  section,  we  fix  nul  and  look  at 

bounds  on  the  size  of  |s(x  )  -  f(x  )  I  when  s  is  the  result  of 

solving  (1.1)  with  values  coming  from  a  function  f  in  (so  that 

vi  “  i*l * • . • » N) .  The  bounds  we  obtain  will  depend  on  how 

x  is  situated  in  relation  to  the  interpolation  points  x.;  roughly 
o  1 

speaking  x  must  be  close  to  a  certain  number  of  the  points  xi  in 

order  to  get  a  good  bound  on  |s(xq)  -  f(xQ)|.  More  precisely,  xq 

must  be  close  to  a  subset  Y  =Y(x  )  of  (x, ,...,x„)  that  is  unisolvent 

for  P  , .  This  set  Y  will  have  m'  =dim  P_  ,  points  and  for  each 
m-i  m-i 

y  in  Y  there  will  be  a  unique  t  in  P  ,  with  €  (y)  =»  1  and 

y  *  i 

*y(Y* )  -  0  for  y'  in  Y~(y). 

Some  additional  notation  will  be  helpful.  If  K  is  a  subset 
of  Rn,  let  diam  K  »  sup(|x-x'  |:x,x'e  K) .  Also,  let 
llfHK  «  sup  <|f(x)|:xe  K).  Put  E^fh^)  ■  inf  { H  h-p!l  B(£  }  :  pe  Pm_1  ) 
where  B(e )  is  the  ball  of  radius  t  centered  at  0.  Recalling 
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standard  results  on  polynomial  approximation,  we  note  that 
Em_^(h,£)  =  0 ( £ m )  when  h  is  sufficiently  smooth. 

Theorem  2_.3:  Fix  nul  and  h  in  Q  (Rn).  Given  f  in  C.  and 
.  m  -  n 

Xx , . . . ,xM  in  Rn,  put  V  =  {g  e  Ch  :  g(xi )  =  f (x1 ) ,  i=l , . . . , N}  and 
let  s  be  an  element  of  V  with  minimal  norm .  For  each  point  xq 
in  R  n  choose  a  Pm_ 1  unisolvent  set  Y ( xq )  c  { x  , . . . , } . 


Then 

|f(Xo)  -  s(xo)|  s  «f«h  [l+A(xo>]  {Em_1(h,d))1/2 

where  d  =  diam{xQ)  u  Y(xq)  and  A(x)  =  £  Ky<x)  I  i?  the 

YeY(xo) 

Lebesgue  function  for  P  interpolation  at  the  points  of 

Y(Xo>. 

y 

Proof :  Consider  the  measure  v  defined  by 

o 

<2-3)  "x  (9)  *  g(*Q)  ■  J  ^y(x0)g(y)- 

°  ye  Y 

For  every  y  e  Y,  v *  U)  -  0.  Thus  v*  is  in  P  ± ,  .  Also, 

xo  y  xo  m_1 

vv  ( ?-•)  *  7(x  )  -  i(x„),  since  f-s  vanishes  on  {x, , ...,xu)  o  Y. 

O  O  IN 

Hence,  Cauchy's  inequality  and  (2.2)  give 
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(2.4) 

|f(xo)-8(xo)| 


l<^  »h,  f-s)h|  S  11^  *hllh  II  f-sil  h  S  II  fl'h  "  *hilh. 
o  o  O 


To  complete  the  proof,  we  need  only  establish 


(2.5) 


*  h"h  s  C1  +  A(xo)]2  Effi-l(h'd, 
o 


To 


show  this,  let  n  C((Rn)  — ►  P_  ,  be  defined  by 

m- 1 


ng  «  £  fl(y)<y.  From  (2.3),  we  have 
yeY 


vx  (9>  =  6x  tI-nlg 
o  o 


where  1*  *  4>  and  6  <p  *  4>(X  ).  For  t  e  Rn,  define 

o 

r  :  C (IP n )  — »  C(Rn)  by  rtg(x)  *  g(x-t).  Note  that 


-h  -  r  h  -  V  <  (X  )  Tvhl 

°  y?v  Y  Y 


Hence,  by  (c)  in  Theorem  1.1 


(2.6) 


»xY  <h»? 

xo  h 


’  ‘.I1"!  ('xh  -  l  Yy*xo*Tyh] 


ye  Y 


s  (1  +  Y  |*  (x  )|)  i»ax  lex  ( I~w  ]Tth| 

te  { x  )u Y  xo 
ye  Y  ‘  o 


For  p  in  P 


m-1 ' 
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[I-ra]Tth  =  [I-n]rt(h-p) . 

Using  lSxJI-n]gl  s  [i  +A(xQ)]  llgll(x  )uy  with  g  =  r t(h-p) 
we  get 


1 6X  t1-*]'rthl  s  U  +  Mxo)]  iirt(h-p)ii  {x  )uy 
o  o' 


If  K  is  any  subset  of  Kn  and  t  e  K,  then 


"Vk  5  "9»B(dlaB  K) 


Taking  K  -  {xq}uY  and  g  =  h-p,  we  see 

|6x  [l-n]Tth|  <  [1  +A(xo)]  II  h-pH  B(d) 


for  every  t  in  (x  }uY  and  every  p  in  P  , .  On  the  right  side, 

o  m-i 

l!h-pllB(d)  can  be  rePiaced  by  Em__1  (h,d)  ;  then  from  (2.6)  we  obtain 
(2.5)  . 
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3. 


Spaces  with  a  reproducing  property. 


This  section  is  devoted  to  a  proof  of  Theorem  1.1.  We  start 
with  uniqueness.  The  following  theorem  characterizes  the 
functions  f  that  belong  to  and  also  their  norm  Hfll^.  This 
characterization  depends  only  on  the  choice  of  h  (and  m  and  n  of 
course)  since  it  is  based  solely  on  the  semi-norm  given  by  (3.2). 
Hence  any  space  that  satisfies  Theorem  1.1  is  uniquely 
determined  by  (n,  m  and)  h. 


Theorem  3.1:  Fix  nuO  and  h  in  Q  (R11).  Let  0,(0?°)  be  any  space  of 

-  -  -  -  —  jg  -  n  —  —  —  — 

functions  on  Rn  that  satisfies  the 

conditions  of  Theorem  1.1.  Then  a  complex  valued  function  f  on 
Rn  Is  In  Ch(Rn)  iff  there  is  a  constant  C(f)  such  that 

(3.1)  |P(T)|  s  C(f  Jilt'll 


for  all  v  In  P"1",  (Rn). 
defined  by 

(3.2)  II V II  * 

xeR 


Here  II  II  denotes  the  semi-norm  on 


_  'l1/2 

t'Ux})  *M(y>)  h(x-y)  j- . 


P 


x 

m-l 


Furthermore .  if  f  is  In  C.^  and  C%(f)  is  the  inf lmum  of  all  the 
constants  C(f)  for  which  (3.1)  holds ,  then  C,(f)  =  llfll^. 


Proof:  If  f  is  in  Ch  then  by  part  (c)  of  Theorem  1.1 

|Mf)|  -  |  ( f*h,  f  )  h|  s  II  t'*hll  h  H  ffii  h. 
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From  (1.3)  and  (3.2)  we  have  II W.  Thus  (3.1)  holds  with 

C(f)  =  llfll^.  This  proves  C„(f)  s  llfll^  and  the  "only  if"  half  of  the 
assertion  about  (3.1). 

To  prove  the  other  half  of  the  theorem  fix  an  f  for  which  a 

constant  C(f)  exists  and  observe  that  (3.1)  holds  with  C(f)  =  C,(f). 

Let  H  =  C./P  ,  and  write  {•,*)«  for  the  inner  product  on  H 
n  m- 1  n 

X 

induced  by  (*,*)u*  Define  L:P_,  — ►  H  by  Lu  -  y*h  +  P  . 

n  m-i  m— l 

Then  HLpII„  *  llp*hll,  =  UtMI.  Using  (3.1)  we  obtain 
H  n  ” 

(3.3)  |*>(lO|  *  C,(f)  IILHIjj 

_  X 

where  =  p(f)  defines  <p  as  a  linear  function  on  P  From 

(3.3  ,  if  Li'1  =  L v2  then  -  <P  ( x* 2 )  *  Thus  there  is  a  unique 

function  *  on  W  *  L(P  such  that  <p(v)  -  *(Lt-)  for  all  v  in 

m—  l 

.  Clearly  ♦  is  linear  and  satisfies  |*(w)|  s  C*(f)ilwilH  for 
all  w  in  W. 

Since  H  is  a  Hilbert  space,  there  is  a  v  in  H  with 

l! vll  „  s  C*(f)  such  that  *(w)  =  (w,v)„  for  all  w  in  W.  Choose  g  in 
H  n 

C.  so  that  v  *  g  +  P_  ,  .  Then 
n  m- 1 

v(l)  =  *(LP)  =  (Lp,v)h  =  (t'*h,g)h  =  f(g). 

,  x 

But  if  t>(r)  -  p(g)  for  all  v  in  P  ,  then,  by  Lemma  3.2 

m- 1 

below,  7  -  g  e  p  .  In  that  case,  f  *  g  +  p  with  p  (and  hence  p) 

in  P  , .  He  conclude  that  f  is  in  C.  and 

m-i  n 
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11  f ')  h  =  n  gli  h  =  II  vll  S  C.(f). 


This  completes  the  second  half  of  the  proof. 

Lemma  3.2:  Let  f  be  a  complex  valued  function  on  Rn.  if  u(t)  =  0 

for  all  v  in  P  "L,  (Rn)  then  f  e  P  , (Rn) . 

-  -  —  m— l  m-i 

Proof:  Let  m' =dim  P  .  (Rn)  and  select  points  x.  , ...,x_,  in  Rn  so 

-  m-i  l  m 

that  a  basis  ,  >  exists  for  P  ,  with  Ux.)  =  6  .. 

l  m  m- 1  i  j  i  j 

For  each  x  in  Rn  define  v  by 

m' 

^X(<P)  ■  <P(x)  -  £  ^1(x)v>(xi )  . 

i  =  l 

Note  that  px  is  in  P^j,  since  “  0  for  i  =  l . m' .  By 

hypothesis,  v  (t)  =0  for  all  x.  Thus 
x  n 

'  -  l  £<V 

1*1 

which  completes  the  proof. 

Existence  of  the  space  described  by  Theorem  1.1  will  be 
proved  by  using  the  following. 

Theorem  3.3:  Given  raaO  and  h  in  Q  (Rn)  there  is  a  Hilbert  space  H 

—  ’  m 

and  a  one  to  one  linear  transformation  U  of  H  into  C(  R^/P  ^ 
such  that  for  everv  v  in  P  there  is  a  vector  77  in  H  that 

- In—  1  — —  V 

satisfies 
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(i)  U> 7  =  *>*h  +  P„  ,  and 

III—  1  - 

(ii)  (^,r,)H  =  ^(f)  whenever  Ur?  =  f  +  Pjn_1. 

Proof  of  Theorem  1.1:  Take  Ch  =  U  (Ui?  :  j?  e  H}  and  define  a  semi- 
inner  product  on  by 

(f,g>h  -  (f1[iV,]'  »'‘[«Vi])k' 

Since  U  is  one  to  one  we  see  that  (f,f).  =  0  iff  fe  P_  ..  Thus 

n  in—  i 

C. /P  ,  is  the  inner  product  space  that  results  by  identifying 
n  m—  l 

f  and  g  whenever  Hf-gll^  =  0.  Evidently,  U  gives  a  unitary 

isomorphism  betwen  H  and  This  verifies  parts  (a)  and  (b) 

of  Theorem  1.1.  Part  (c)  follows  easily  from  (i)  and  (ii).  Since 
uniqueness  was  established  by  Theorem  3.1,  the  proof  is  complete. 

Proof  of  Theorem  3.3:  If  \>  and  \  are  measures  on  Rn,  and  have 

support  consisting  of  a  finite  number  of  points,  we  take 


(3.4) 


(y,\)  =  |  |  h(x-y)  d^(y)  dA.(x) 
■  £  ATS)  v  (y)  h(x-y) . 

x,y 


The  resulting  function  is  linear  (conjugate  linear)  in  its  first 

(second)  argument.  For  v  e  P  we  have  (t*,«^)  z  0  because 

m—  l 

h  is  in  Q  .  Also,  the  polarization  identity  gives  ( \,  v)  =  (  v,  X) 
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for  v ,  \  in  P  ,  .  This  shows  that  (*,•)  is  a  semi  -  inner 
m-i 

x  x  x 

product  on  P  ,  .  Thus  P  ,/N,  where  N  ■  (y  e  P  ,  :  (y,y)  =  0), 
m- 1  m —  1  m-i 

is  an  inner  product  space.  Let  H  be  its  Hilbert  space  completion 

and  let  n  ■.  p  — »  H  be  the  map  given  by  rcy  =  y+N.  Note  that 

m- 1 

( rw  ,  nv  )  =  ( y , v  )  . 

As  in  the  proof  of  Lemma  3.2,  we  choose  a  P  ,  unisolvent  set 

m-i 

n  -1- 

of  points  x, , . . . ,  x  ,  in  R  and  define  y  e  p  by 
i  m  x  m—  l 


m 


-  6x  -  l  V*'6*, 

i  =  l  1 


,n 


We  define  U  :  H  — ♦  C<tR “)/P  ,  by  Urj  =  f  +  P  , 

m-i  tj  m- 1 


where 


(3.5)  38  ^  ,1tVy)  ft. 

To  verify  that  f  is  continuous  we  note  II  Try  -  wy  II  =  i  y  -  y  H 

T)  t  Z  H  t  Z 

and  use 

(3.6)  lim  II  y  -  v  II  =  0. 

t— *z  X  Z 

^  z 

To  see  this,  write  y.  -  y_  =  6.  -5  +  o  ’  where 

t  z  t  z 

m' 

■  l  «,(*)  -  V"1  8*  • 

i-1  1 

Using  sesqui- linearity  and  (6  ,6  )  «  h(y-x) , 

x  y 
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H  f  t  -  v^\2  =  2h(  0  )  -  h(z-t)  -  h(t-z)  +  ( <7 t '  Z ,  at,z) 

+  (6t  -  6z,  at,z)  +  (o* ' 2 ,  6t-6z)  . 
m' 

Now  (6t  -  6z,  at ' 2)  =  £  [^(z) 

1=1 

which  tends  to  0  as  t  — ►  z. 
terms,  we  obtain  (3.6). 

Next  we  show  that 

(3.7)  ^(f^)  =  (^'^h 


-  ^(t)]  [hfx^t)  -  hfXj-z)] 

After  similar  analysis  of  other 


for  all  y  e  p  X  Writing  v  -  S  y(x)  6 
m- 1  la  X 

X 

0  =  y(<A)  ■  £  y{x)  ^(x)  we  find 
x 


and  using 


(3.8)  v  =  £  y  (x)  yx- 

x 

Prom  (3.5),  Mf^)  *  £  Mx)  f^  (x)  =  £  y(x)  Applying 

X  X 

(3.8)  to  this,  we  get  (3.7). 

The  map  U  is  clearly  linear.  To  check  that  it  is  one  to  one, 

suppose  Urj  m  P_  ,  .  Then  f  is  in  P  ,  and  from  (3.7)  we  have 
in- 1  77  m-i 

0  ■  («y,i7)„  for  all  y  in  P  Since  the  image  of  n  is  dense  in 

H,  we  conclude  tht  t)  ■  0.  Thus  U  is  one  to  one. 

To  complete  the  proof  we  show  that  (1)  and  (11)  hold  for 


21 


r)v  -  nv .  From  (3.5)  . 


f  (2)  -  (^.™Z)H  =  {P'V 

* V 


£  ^2(X)  p(y>  h(x-y) 


x,y 


m 


*  £  (y >  |§z{x)  -  £  ^(z)^  <x>]  h<x-v) 
x,y  1*1  1 


HI 

=  £  *My)  j^h(z-y)  -  £  ^1(z)h(xi-y)j 


1  =  1 


Thus  f  =  v*h  +  p  which  gives  (i).  If  CJt?  *  f  +  P  then 

77  V  nr- 1 

9v 

f  *  +  p  and  (ii)  follows  from  (3.7). 
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Polyharmonic  Cardinal  Splines 

W.  R.  Madych*  S.  A.  Nelson* 


Abstract 

Polyharaonic  splines,  sometimes  called  thin  plate  splines,  are  distribu¬ 
tions  which  are  annihilated  by  iterates  of  the  Laplacian  in  the  complement 
of  a  a  discrete  set  in  Euclidean  n-space  and  satisfy  certain  continuity  con¬ 
ditions.  The  term  cardinal  is  often  used  when  the  set  of  knots  is  a  lattice. 
Here,  in  addition  to  developing  certain  basic  properties  of  polyharmonic 
cardinal  splines,  it  is  shown  that  such  splines  interpolate  numerical  data 
on  the  lattice  uniquely. 


1  Introduction. 


From  one  point  of  view,  I.  J.  Schoenberg’s  theory  of  univariate  cardinal  splines 
of  odd  order,  see  [15],  can  be  regarded  as  a  development  of  certain  properties  of 
those  functions,  /,  which  satisfy 


(1) 


dx2* 


=  0 


on  the  complement  of  the  integer  lattice  Z  and  enjoy  appropriate  smoothness 
conditions  on  all  of  the  real  line  R.  A  natural  extension  of  these  ideas  to  the 
multi-variate  case  would  be  to  consider  those  functions  /  which  satisfy  differen¬ 
tial  equations  analogous  to  (1)  on  the  complement  of  the  integer  lattice  Z "  in 
A"  and  enjoy  certain  regularity  properties  on  all  of  Rn.  In  this  development  we 
consider  the  case  where  the  differential  operators  are  powers  of  the  Laplacian. 
Many  of  the  results  in  [15]  have  appropriate  analogues  in  this  case.  In  this  paper 
we  consider  only  the  basic  properties  of  such  splines  together  with  the  problems 
of  existence  and  uniqueness  of  cardinal  interpolation. 

The  motivation  for  our  work  came  from  an  attempt  to  obtain  a  ‘B  spline 
like’  basis  for  certain  global  interpolation  schemes  in  Rn.  More  precisely,  given  a 

'Department  of  Mathematics,  University  of  Connecticut,  Stone,  CT  06268.  Both  authors 
were  partially  supported  by  a  grant  from  the  Air  Force  Office  of  Scientific  Research,  AFOSR- 
86-0145 

*  Department  of  Mathematics,  Iowa  State  University,  Ames,  IA  50011. 
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collection  of  points  xi, . . . ,  xm,  in  Rn,  consider  the  linear  subspace  of  functions, 
/,  of  the  form 

m 

(2)  /{*)  =  ^a^(x-x>) 

>=i 

where  <f>  is  some  fixed  smooth  function  and  oi, . . . ,  am  are  arbitrary  coefficients; 
call  this  subspace  V+.  Such  functions  are  natural  and  simple  candidates  for 
interpolants  of  multivariate  scattered  data.  In  several  interesting  examples, 
such  as  <p(x)  =  |x|  or  ^(x)  =  \/l  +  |x|J,  the  function  <t>  does  not  decay  at 
infinity;  see  [7,8]  for  these  and  other  examples.  As  one  may  suspect,  this  causes 
various  problems,  both  practical  and  theoretical.  However,  it  is  not  difficult  to 
see  that,  at  least  for  the  examples  mentioned  above,  certain  linear  combinations 
of  translates  of  namely  functions  of  form  (2),  decay  at  infinity  rather  quickly. 
It  was  hoped  that  such  combinations  would  form  a  nice  basis  for  V*  analogous  to 
that  formed  by  the  B  splines  in  the  classic  univariate  examples.  In  attempting 
to  formulate  a  tractable  theory  we  were  led  to  consider  the  case  where  the  set 
of  points  *i, . . .  ,xm  becomes  the  integer  lattice  Zn  in  Rn  and  the  functions  <f> 
are  fundamental  solutions  to  certain  powers  of  the  Laplacian.  This  motivated 
us  to  examine  Schoenberg’s  work,  [14,15],  more  carefully  and  resulted  in  the 
development  introduced  here. 

The  idea  of  interpolating  in  terms  of  linear  combinations  of  Green’s  func¬ 
tions  to  powers  of  the  Laplacian  is  not  new.  Although  the  earliest  published 
work  devoted  to  the  subject  seems  to  be  [10],  it  is  quite  clear  that  many  mathe¬ 
maticians  were  aware  of  the  idea  and  many  of  its  consequences,  either  from  the 
reproducing  kernel  Hilbert  space  viewpoint  or  from  the  transparent  generaliza¬ 
tion  of  the  variational  aspect  of  univariate  spline  theory  to  the  multivariate  case; 
for  instance  see  [9],  For  examples  of  more  recent  work  see  [6,7,8,13].  Among 
the  shortcomings  of  the  obvious  theory  were  the  fact  that  such  ‘splines’  do  not 
have  a  localized  basis  and  the  restriction  to  the  case  of  the  finite  domain.  In  [6] 
Duchon  developed  a  variational  theory  for  interpolation  to  all  of  /Z"  involving 
a  finite  number  of  constraints  which  overcomes  the  second  mentioned  short¬ 
coming  in  an  elegant  way  and  allows  for  interesting  generalizations.  Although 
our  development  concerns  an  infinite  number  of  constraints  and  does  not  rely 
on  the  variational  properties  of  splines,  it  may  also  be  regarded  as  a  certain 
generalization  of  [6]. 

While  working  on  an  early  draft  of  our  theory  we  discovered  that  the  subject 
of  ‘cardinal  spline  interpolation’  was  a  booming  business;  for  example  see  [3], 
[4],  and  the  references  cited  there.  (In  addition  to  references  on  multivariate 
cardinal  splines,  the  extensive  bibliography  in  [3]  contains  many  references  to 
work  involving  the  Green’s  function  type  splines  mertioned  above.)  However, 
although  some  of  our  results  may  have  analogues  in  the  works  cited  above,  we 
felt  that  this  development  had  enough  novelty  to  warrant  completion. 

This  paper  is  organized  as  follows.  In  Section  2  we  give  the  definitions  and 
derive  the  basic  properties  of  k-harmonic  splines.  The  cardinal  interpolation 
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problem  for  t-harmonic  splines  is  taken  up  in  Section  3  where  it  is  shown  that 
under  certain  circumstances  this  problem  has  a  unique  solution.  The  relation¬ 
ship  of  these  splines  to  the  multivariate  analogue  of  the  Whittaker  cardinal  series 
is  indicated  at  the  end  of  that  section;  this  was  prompted  by  a  question  raised 
by  C.  de  Boor. 

We  use  mathematical  notation  which  is  standard  when  dealing  with  multi¬ 
variate  functions.  For  example,  the  symbols  p  and  v  usually  will  denote  multi¬ 
indexes,  * “  =  *5“  . . .  z|J*,  etc.;  S(Rn)  and  S'(/in)  denote  the  Schwarts  space  of 
rapidly  decreasing  functions  and  its  dual,  the  space  of  tempered  distributions. 
The  introductory  chapter  of  [11]  contains  a  concise  summary  of  this  so-called 
multi-index  notation  and  basic  facts  on  distributions  and  Fourier  transforms; 
other  references  which  contain  basic  material  used  here  concerning  distributions, 
Fourier  transforms,  and  several  complex  variables  are  [2],  [5],  and  [16].  For  the 
Fourier  transform  we  use  a  standard  normalization  which  is  slightly  different 
from  that  used  in  [11],  namely, 

*©»(*)-*  /  )dx 

when  ^  is  in  5(iZ");  here  the  integral  is  taken  over  all  of  RT  and  ^  is  the  Fourier 
transform  of  In  what  follows,  integrals,  as  in  the  above  case,  are  taken  over 
RT  unless  specifically  denoted  otherwise. 


2  Definitions  and  basic  properties. 

Recall  that  a  function  or  distribution  u  is  said  to  be  k-harmonic,  k  a  positive 
integer,  if 

(3)  A*u  =  0 

on  R".  Here  A  is  the  usual  Laplace  operator  defined  by 

and,  if  k  is  greater  than  one,  A*  denotes  its  fc-th  iterate,  A*u  =  A(Ak-1ti).  Of 
course  A1  =  A.  A  polyharmonic  function  is  one  which  is  t-harmonic  for  some 
positive  integer  k ;  for  a  treatise  on  the  subject  see  [1]. 

The  class  fft(Rn)  is  the  collection  of  all  t-harmonic  tempered  distributions. 
In  what  follows  the  classes  Hk(Rn)  play  a  role  similar  to  that  played  by  the 
polynomials,  Ilaa—  i (A),  in  univariate  spline  theory.  Indeed  we  have  the  follow- 
ing. 

Proposition  1  The  class  Ht(Rn)  is  a  subspace  of  polynomials  which  contains 


Proof  If  u  satisfies  (3)  then  its  Fourier  transform,  u,  satisfies  |(|J‘u(0  =  0 
for  all  {  in  R" .  It  follows  that  it  is  a  distribution  supported  at  the  origin  and  thus 
must  be  a  finite  linear  combination  of  the  Dirac  distribution  and  its  derivatives. 
Hence  u  must  be  a  polynomial.  That  Hk(Rn)  contains  Il2t_i(7?n)  follows  from 
the  fact  that  A*  is  a  homogeneous  differential  operator  of  order  2Jk.  ■ 


For  k  a  positive  integer  satisfying  2i  >  n  +  1,  we  define  SHk(Rn)  to  be  the 
subspace  of  S'(Rn)  whose  elements  /  enjoy  the  following  properties: 

,  ,  (»)  /  is  in  C2k-n-l(Rn )  and 

W  (ii)  A*/  =  0  on  Rn  \  Zn. 

Here  Z  denotes  the  set  of  integers  and  Zn  denotes  the  integer  lattice  in  Rn. 
Elements  of  Zn  are  denoted  by  boldface  symbols  such  as  j  and  m. 

A  k-harmonic  cardinal  spline  is  an  element  of  SHt(Rn).  We  say  that  a 
function  or  distribution  is  a  polyharmonic  cardinal  spline  if  it  is  in  one  of  the 
classes  SHk(RT). 

The  reason  for  the  condition  2k  >  n  +  1  can  be  explained  as  follows.  If 
2k  <  n  +  1  any  distribution  which  is  locally  in  L°°  and  satisfies  condition  (4ii) 
must  be  fc-harmonic  on  Rn.  Thus  if  SHk(Rn)  is  to  consist  of  functions  which 
satisfy  (4ii)  and  for  which  pointwise  evaluation  on  Zn  makes  sense  then  the  last 
observation  implies  that  SHk(Rn)  must  in  fact  be  the  space  Hk(Rn)-  Like  the 
space  of  polynomials  in  the  case  n  =  l,  the  class  Hk(Rn)  can  only  interpolate 
very  restricted  data  on  Z".  Since  we  wish  the  space  SHk(Rn)  to  be  rich  enough 
to  interpolate  a  wide  class  of  data  on  Zn,  we  assume  2k  >n  +  l. 

In  what  follows  we  always  assume  that  2k  >  n  +  1.  For  the  sake  of  clarity 
however,  we  will  remind  the  reader  of  this  from  time  to  time. 

Fundamental  solutions  of  (3)  play  an  important  role  in  the  description  of 
SHk{R I").  For  future  reference  we  define  Ek  to  be  the  fundamental  solution  of 
(3)  given  by 


(5) 


P  /_x  _  /  e(n.  k)|*|M_"  if  n  is  odd 

*'  \  c(n,  fc)|x|Jk_n/oj|x|  if  n  is  even 


where  c(n,k)  is  a  constant  which  depends  only  on  n  and  k  and  is  chosen  so  that 
A kEk(z)  =  6(z).  Here  6{z)  denotes  the  unit  Dirac  distribution  at  the  origin. 
The  Fourier  transform  of  Ek  is 

(6)  Et(  0  =  (2x)-"'3(— Kl1)'*- 


The  following  propositions  give  some  of  the  basic  properties  of  the  spaces 

Sffk(ir). 

Proposition  2  Iff  is  a  tempered  distribution  then  the  following  conditions  are 
equivalent: 
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(i)  f  is  in  SHk(Rn). 


(ii)  f  satisfies 

(7)  Ak/(*)  =  X)aji(*"i) 

where  the  a’s  are  constants  and  the  sum  is  taken  over  alt j  in  Zn . 

Proof  Suppose  /  is  in  S Hk{Rn).  To  see  that  /  satisfies  (7)  observe  that  in 
a  sufficiently  small  neighborhood  N  of  any  point  j  we  have 

a  */(*)  = 

¥ 

where  the  sum  is  taken  over  some  finite  set  of  multi-indicies  v.  Representation 
(7)  will  follow  if  we  can  show  that  6„  =  0  for  v  0.  To  see  this  let  <j>  be 
any  infinitely  differentiable  function  with  support  in  N  such  that  4>(x)  =  1  in  a 
neighborhood  of  j.  Then,  since  /  is  in  C°°(Rn  \  Zn), 

A*(*/)  =  £*.0r«(*-j)+* 

¥ 

where  i/>  is  an  infinitely  differentiable  function  with  support  in  N .  Now,  if  IS  is 
any  fundamental  solution  of  (3)  then 

<f>f  =  E  *  (A  kd>f)  =  -  j)  +  E  *  V- 

¥ 

where  E  *  il>  is  infinitely  differentiable  on  Rn .  The  fact  that  6„  =  0  for  v  ^  0 
follows  from  the  last  equation,  the  fact  that  <f>f  is  in  C2k~n  l(Rn),  and  the 
behavior  of  D"  E(x  —  j)  in  a  neighborhood  of  j. 

To  see  that  (7)  implies  that  /  is  in  C2k~n~l(Rn)  observe  that  in  any  suffi¬ 
ciently  small  neighborhood  S  of  j  /(*)  —  aj  E(x  —  j)  is  equal  to  a  ^-harmonic 
function  and  therefore  /(*)  —  aj E(x  —  j)  is  in  C°°(N).  Note  that  E(x  —  j)  is 
in  CIi~n~1(Rn)  and  hence  it  follows  that  /  is  in  C2k~n~l(N).  The  desired 
conclusion  is  now  an  easy  consequence  of  this  fact.  H 


In  what  follows  we  say  that  a  sequence  aj  ,  j  in  Zn,  is  of  polynomial  growth  if 
there  are  constants  c  and  p  such  that  |aj|  <  c(  1  +  |j|)p  for  all  j.  Similarly  a  locally 
bounded  function  /  is  said  to  be  of  polynomial  growth  if  |/(r)|  <  c(l  +  |x|)p  for 
all  *  in  Rn .  The  following  observation  is  an  easy  consequence  of  the  definitions. 

Proposition  3  If  f  is  in  SHit(Rn )  then  the  coefficients  in  representation  (7) 
are  snifse  and  are  of  polynomial  growth.  Furthermore,  if  f\  and  /j  are  in 
SHk(Rn)  and  A*/i  =  A*/a  <Aen  A  “  A  «  «"  #*(*")• 
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The  proof  of  the  following  proposition  is  somewhat  technical  and  perhaps 
disruptive  to  the  flow  of  main  ideas  of  this  section.  We  include  it  for  complete¬ 
ness. 

Proposition  4  If  f  is  in  SHk(Rn)  then  f  is  of  polynomial  growth. 

Proof  For  <t>  in  S(Rn)  let 

Mm,*  =  suplx1*  D"  4>(z)\ 

where  the  supremum  is  taken  over  all  x  in  Rn.  Since  /  is  in  S'(Rn)  there  are 
constants  M ,  N,  and  C\  so  that 

(8)  i</.*>i<ci5>u* 

where  the  sum  is  taken  over  all  multi-indexes  p  and  u  such  that  0  <  |/j|  <  M 
and  0  <  |i/|  <  N.  Since  /  is  in  SHt(Rn)  there  are  constants  M\  and  Cj  such 
that 

(9)  KA*/^)|<Cj^Mm.o 

where  the  sum  is  taken  over  ail  multi-indexes  fi  such  that  0  <  |pf  <  M\. 
Observe  that  {/,  ^)  =  (f,4>i)  +  ((— A)k/,  4>\)  and  by  induction 

(10)  (/,*>  =  </, *-»>  +  £((- A)*/, 

i= i 

where  <hj  is  defined  by  the  formula  for  its  Fourier  transform 

(11)  *i«)*(i  +  KI*V*0 

Formula  (11)  together  with  properties  of  the  Fourier  transform  imply  that 

(12)  *"<M*)  =  £?*  *  *M*) 

I *<(i 

where  is  defined  by  V’m(x)  =  x’M*)  a*>d  the  g„  are  bounded  continuous 
functions.  Hence  there  is  a  constant  C3  such  that 

(13)  MU<C3W|*^(*)|dx. 

*<M  J 

Similar  reasoning  shows  that  if  m  satisfies  2k(m  —  1)  >  \u\  then 

(14) 

*<m'/ 

where  C4  is  a  constant  independent  of  <fr. 
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Formula  (10)  together  with  estimates  (8),  (9),  (13),  and  (14)  imply  that 
there  are  positive  constants  C  and  a,  independent  of  <j>,  such  that 

(is)  !</,*)!  <c/(i  +  |*!m*)|d* 

for  all  d  in  S(Rn).  Estimate  (15)  together  with  Riesz  representation  imply  the 
desired  result.  B 


This  last  proposition,  when  combined  with  the  fact  that  continuous  functions 
of  polynomial  growth  are  distributions  in  S'(Rn)  shows  that  SHt{Rn)  could 
be  defined,  without  any  loss  of  generality,  as  the  class  of  continuous  functions 
which  satisfy  (4)  and  are  of  polynomial  growth. 

In  the  case  n  =  1  SHk(Rn)  is  the  subspace  of  Sm,  m  =  2fc  —  1,  consisting 
of  functions  of  polynomial  growth.  The  space  Sm  is  the  space  of  piecewise 
polynomial  functions  defined  by  Schoenberg,  see  [15].  The  reason  we  restrict  our 
attention  to  S'(Rn)  is  because  our  development  relies  on  the  use  of  the  Fourier 
transform.  Thus  in  spirit  this  development  is  similar  to  that  in  Schoenberg’s 
earlier  work  [14]. 

If  a  is  a  real  parameter  we  define  SH%(Rn)  to  be  that  subspace  of  SHi(Rn) 
consisting  of  functions  /  which  satisfy  |/(*)|  <  c(l  +  |z|)°  for  some  constant  c. 
As  an  immediate  consequence  of  Proposition  4  we  have  the  following. 

Corollary  1  SHk(Rn)  =  (jS/fJ'(/Zn)  where  the  union  is  taken  over  all  real  a. 

To  complete  our  list  of  basic  properties  of  SHt(Rn)  we  include  the  following. 
Proposition  5  Given  a  sequence  {aj},  j  in  Zn,  which  is  of  polynomial  growth, 
there  is  an  f  in  SHt(Rn)  such  that 

(16)  A*/(*)  =  X)aj*(*“i)' 

Proof  Recall  that  A*u  =  v  has  a  solution  u  in  S'(Rn)  whenever  v  is  in 
S'(Rn);  for  example  see  [12].  The  hypothesis  implies  that  the  right  hand  side 
of  (16)  is  a  tempered  distribution  and  thus  there  is  a  tempered  distribution  / 
such  that  (16)  holds.  That  /  is  in  SHk{Rn)  now  follows  from  Proposition  2.  ■ 


Proposition  6  SHk(Rn)  is  a  closed  subspace  of  S'(Rn). 

Proof  The  mapping  /  — *  A*/  is  continuous  as  an  operator  from  S'{Rn) 
to  S'(Rn),  which  means  that  the  inverse  image  of  a  closed  set  is  closed  under 
this  mapping.  Now,  the  set  of  those  elements  in  S'(Rn)  consisting  of  Radon 
measures  supported  on  Zn  is  a  closed  subspace  of  S'(Rn),  and,  since  SHi(Rn) 
is  the  inverse  image  of  this  subspace  under  the  mapping  described  above,  the 
desired  result  follows.  M 
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3  Cardinal  spline  interpolation 

The  problem  of  cardinal  interpolation  for  k-harmonic  splines  is  the  following: 

Given  a  sequence  of  real  or  complex  numbers,  v  =  {tij},  j  in  Zn, 
find  an  element  /  in  SHt(Rn)  such  that  /(j)  =  vj  for  all  j. 

This,  of  course,  is  a  simple  generalization  of  the  standard  problem  in  the  uni¬ 
variate  case,  see  [15,  p.  33]. 

Since  elements  of  SHk{Rn)  are  of  polynomial  growth  it  is  clear  that  in  order 
for  this  problem  to  have  a  solution  a  necessary  requirement  on  the  sequence 
v  is  that  it  also  be  of  polynomial  growth.  This  requirement  is  also  sufficient, 
as  we  shall  show.  We  begin  by  first  considering  the  fundamental  functions  of 
interpolation. 

The  function  L*  is  defined  by  the  formula  for  its  Fourier  transform: 

(17)  £‘K)  =  (2'r"/!rf^' 

If  k  is  an  integer  such  that  2 k  >  n+ 1  then  L*(£)  is  well  defined  as  an  absolutely 
convergent  integral.  This  function  is  the  fundamental  function  of  interpolation 
for  fc-harmonic  splines.  The  reason  for  this  terminology  is  the  fact  that  L*(j)  = 
#0j,  where  S0 j  is  the  Kronecker  delta.  This  and  other  properties  of  L*  and  some 
of  the  consequences  for  the  interpolation  problem  are  stated  in  Propositions 
7  and  8.  Before  turning  to  these  propositions  however,  we  need  to  consider 
certain  technical  properties  and  lemmas  concerning  L*  and  the  related  periodic 
distribution,  $»,  defined  by 

(i«)  **(0  =  (-KI’)‘i»(0- 

Given  a  subset  A  of  the  real  line  R  and  a  positive  number  t,  A,  is  the  subset 
of  the  complex  plane  defined  by 

A,  =  {r  £  C  :  Sir  £  A  and  -  e  <  Or  <  e} 

where  Sir  and  Or  are  the  real  and  imaginary  parts  of  r  respectively.  Similarly 
A"  =  At  x  •  •  ■  x  A,  is  a  subset  of  Cn.  The  symbol  Q  denotes  the  interval  —  ir  < 
p<*  and  Qn  denotes  the  cube 

Qn  =  U  =  Ui, •••.£»)  •  -*  <  Cj  <  i  =  i . »»} 

Lemma  1  The  functions  and  have  extensions  which  are  analytic  in  a 
tube  R%,  for  some  e  >  0. 

Proof  For  £  and  ij  in  Rn,  let 

<  =  (<1.  •  •  ■  .<n)  =  (Cl  +  *17l . Cn  +  irin)  =  C  +  *»7 
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denote  a  point  in  complex  n-space,  Cn,  and  put 


«K)  =  -£<L 

m=l 

Observe  that 

(19)  (2T)»'2[it(o]-1  =  {i + m]kmM0]-k 

where 

m=  E  ?(C —  2irj)_t 

j€2*\{0) 

Choose  «  small  enough  so  that  q(Q  ^  0  for  all  £  in  F"  \  Q".  Then  it  is  readily- 
checked  that  F  is  analytic  in  Q For  £  in  Qn,  (?({)]*  F(^)  >  0.  Thus,  by 
reducing  c  if  necessary,  we  may  assume  that  1  +  [«(C)]*F(C)  has  no  zeros  in  Q". 
Now,  from  (19),  it  follows  that  <&*  extends  analytically  to  Q "  and  hence,  by 
periodicity,  it  extends  analytically  to  F" . 

The  analytic  extension  of  L*  is  given  by  $*(C)[9(C)]-t-  From  (19)  it  is 
evident  that  this  extension  is  analytic  in  Q".  Analyticity  on  the  rest  of  F"  is 
clear  from  the  fact  that  q(Q  ^  0  there.  H 


Lemma  2  The  Fourier  transform  of  is  u  a  sum  of  constant  multiples  of  trans¬ 
lates  of  the  delta  function.  More  precisely,  9k  =  9k  and 

(20)  *k(z)='£ai6(x-i) 

jcz* 

where  the  aj’s  depend  on  k  and  n.  Furthermore,  there  are  positive  constants,  C 
and  c,  which  are  independent  of  j  svcA  that 

(21)  |aj|  <  Cexp(-c|j|) 

for  all  j. 

Proof  The  periodicity  of  implies  that  satisfies  (20)  with 

(22)  oj  =  (2»)-"'J  e^9k(0dt 

Now,  by  virtue  of  analyticity  of  9k  the  set  Qn  in  (22)  can  be  replaced  by 
{<  :  €  Qn  and  =  7)  where  7  =  (7i,  ■  ■  • ,  7n).  7m  «e  constants,  |7ml  = 

«/2,  m  =  1, ....  n,  and  the  sign  of  7m  is  chosen  so  that  (j,  7)  >  0  whenever  j  ^  0; 
here  f  is  the  same  as  that  in  Lemma  1.  Upon  doing  this,  a  routine  estimate  of 
the  resulting  integral  gives  (21).  I 
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Proposition  7  Let  L*  be  defined  by  the  formula  for  its  Fourier  transform  (17), 
where  k  is  an  integer  which  satisfies  2k  >  n  +  1.  Then  Lk  has  the  following 
properties: 

(i)  Lk  is  a  k-harmonic  cardinal  spline. 

(it)  For  all  j  in  Zn 

(23)  =  {  0  !/  jjo 

(Hi)  There  are  positive  constants  A  and  a,  depending  on  n  and  k  but  independent 
of  x,  such  that 

(24)  |£i(*)i  <  /texp(-a|x|) 
for  all  x  in  Rn. 

(iv)  Lk  has  the  following  representations  in  terms  of  Ek: 

(25)  Lk(x)  =  aj£*(x  -  j)  =  *  Ek(x) 

jez* 

where  is  the  function  whose  Fourier  transform  is  defined  by  (18)  and  the 
dj 's  are  the  constants  defined  in  Lemma  2.  The  series  converges  absolutely  and 
uniformly  on  all  compact  subsets  of  Rn . 

Proof  (i)  This  follows  from  (20)  and  the  fact  that  A kLk  = 

(ii)  Observe  that  Lk(^  —  2xj)  =  (2ir)-”/2,  and  write 

£*U)  =  (2» rn'2  [  Lk((yMdt  =  (2t)-"/3  53  /  it(C  -  2irm)e‘<j  (>d( 

=  (2ir)-"/J/  53  i*(^-2^m)eI(j«)^=-i-/  e^d*. 

•'<?’  m€Z*  (2 '  •'<?* 

The  desired  result  is  now  an  immediate  consequence  of  the  last  formula. 

(iii)  The  proof  of  this  estimate  is  analogous  to  the  proof  of  (21)  in  Lemma 

2. 

(iv)  This  is  a  transparent  consequence  of  the  definitions  and  Lemma  2.  ■ 


For  later  reference,  we  define  ya ,  a  real,  to  be  the  collection  of  those  se¬ 
quences  v  =  {vj},  j  in  Zn,  which  satisfy 

(26)  |«j|  <  C(1  +  Liir 
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for  some  constant  c.  Note  that  these  classes  are  analogous  to  the  ones  in  [15,  p. 
34];  they  will  also  be  used  here  in  a  similar  fashion. 

Proposition  8  Suppose  v  =  {uj}>  j  ,n  Zn,  is  a  sequence  of  polynomial  growth 
and  fv  is  the  function  defined  by 

(27)  /,(*)=  E 

jez* 

Then  the  following  is  true: 

(i)  The  expansion  (27)  converges  absolutely  and  uniformly  in  every  compact 
subset  of  Rn . 

(it)  The  function  fv  is  a  k-harmonic  spline  and  /„( j)  =  vj  for  all  j. 

(Hi)  If  v  is  in  then  fv  is  in  SH£(Rn). 

(iv)  If  v j  =  P(j)  for  allj,  where  P(x)  is  a  k-harmonic  polynomial  then  /»(*)  = 
P(x)  for  all  x  in  R". 

Proof  Items  (i)-(iii)  are  immediate  consequences  of  Proposition  7. 

(iv)  Suppose  P  is  a  fc-hacmonic  polynomial  and  f  is  defined  by 

/(*)=  E  p( j)£*(*-j)- 

jez* 

Recall  that  any  locally  integrable  function  g  of  polynomial  growth  is  in  S'(Rn); 
furthermore  for  any  0  in  S(Rf>)  we  have 

($.0)  =  J  ff(*)0(*)<k  and  g  *  0(*)  =  J  ff(y)0(*  -  y)dy. 

To  prove  (iv)  of  this  proposition  it  suffices  to  show  that 

(28)  (/,0)  =  <P,0> 

for  all  0  in  $(/?”). 

To  see  (28)  observe  that 

(29)  </,0)  =  e  p(i)^  *  0U)  =  (2*)"/’  e  ipvwutm))}^ j 

j €Z»  j«Z* 

where  the  last  equality  follows  by  virtue  of  the  Poisson  summation  formula.  To 
evaluate  the  expression  on  the  extreme  right  in  (29)  set 

Ai  =  [P(»D)(Zt(O0«))]f=Jw j 
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and  observe  that  for  each  j  in  Zn  L*  may  be  expressed  as 


(30)  (2t)  Lk(0  -  j  ^  _  2«j|**^.j(0  oth 


=  0 
otherwise 


where  the  t/>j’s  are  smooth  functions  such  that  ^j(f)  =  0j(£)tf>(£)  is  a  test  func¬ 
tion  in  5(/2")  for  each  j.  In  view  of  (30)  we  may  write 


(31) 


(2*)"/^  =  | 


/  P(*)[HX)  +  (-A)‘<£0(*)]dar 
/  P(x)(- A)*[e-,‘ti',)^j(*)]dr 


if  j  =  0 
otherwise. 


Now,  integrating  by  parts  and  using  the  fact  that  A*P  =  0  results  in 

(32)  J  P(*)(-A)‘[e-,<j'*^j(*)]dx  =  j  [(-A)*  P(*)]e  d>j(x)dx  =  0 


when  j  /  0.  Similar  reasoning  shows  that 

(33)  (2x)nl*Ao  =  J  P(x)<t>(x)dx. 

Formulas  (29),  (30),  (31),  (32)  and  (33)  imply  (28)  which  is  the  desired  result. 


It  should  now  be  clear  why  Lk  is  called  the  fundamental  function  of  inter¬ 
polation  for  ^-harmonic  splines.  Note  that  items  (ti)  and  (tv)  of  the  previous 
proposition  may  be  restated  as  follows. 

Corollary  2  If  the  data  v  is  of  polynomial  growth  then  the  cardinal  interpola¬ 
tion  problem  for  k-harmonic  splines  has  a  solution  which  has  a  unique  represen¬ 
tation  in  terms  of  fundamental  functions  of  interpolation.  The  solution  is  given 

by 

(34)  /«(*)= 

j  €Z* 

We  now  take  up  the  question  of  uniqueness  by  first  considering  the  following 
technical  lemma. 

Lemma  3  If  f  is  in  SHt(Rn)  and  f  is  Znperiodic  then  f  is  a  constant. 
Proof  The  hypothesis  implies  that 

fit)  =  £  “  2*J)  and  A*/(*)  =  a^b{x-  j), 
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where  both  sums  are  taken  over  all  j  in  Zn;  a  and  the  cj’s  are  constants.  These 
formulas  together  with  Poisson  summation  imply 

(35)  (— |2wjJ2)fccj  =  a 

for  all  j  in  Zn.  The  equation  corresponding  to  j  =  0  in  (35)  implies  that  a  is 
0;  the  rest  of  the  equations  in  system  (35)  imply  that  cj  =  0  whenever  j  ft  0. 
Thus  f(x)  =  Co,  which  is  the  desired  result.  H 


Proposition  9  If  f  is  in  SHt(Rn)  and  /(j)  =  0  for  all  j  in  Zn  then  f  is 
identically  0. 


Proof  Recall  that 

(36)  A*/(r)  =  cj5(r- j). 

jez* 

Now,  if  cj  =  0  for  all  j,  /  must  be  a  i-harmonic  polynomial.  This  together  with 
the  fact  that  /(j)  =  0  for  all  j  implies  the  desired  result. 

Thus  to  complete  the  proof  it  suffices  to  show  that  cj  =  0  for  all  j. 

To  see  this,  write 

tf(*)  =  £  Cjl*(*-j), 
jez* 


and  observe  that 

(37)  A*(tf -♦*•/)  =  0 


where  4*  is  the  distribution  defined  by  Lemma  2.  From  (37)  it  follows  that 
g-*k*f  is  a  i-harmonic  polynomial  P.  Since  4*  »  /(j)  =  0  for  all  j  it  follows 
that  j(j)  =  P(j)  =  cj. 

Now,  if  P  ft  0,  there  is  a  finite  difference  operator,  T,  such  that 


(38)  rP(*)  =  ][>jP(z-j)  =  P 

Ur 


where  the  sum  is  taken  over  a  finite  subset  F  of  Zn  and  B  is  a  non-zero  constant. 
Write 

(39)  A*T/(x)  =  TA*/(*)  =  £  rP(j)«(z  -  j)  =  B  £  6(*  -  j) 

jez*  jez* 


and  observe  that  (39)  means  that  Tf(x  -  j)  -  Tf(z)  is  a  t-harmonic  polynomial 
for  each  j.  This,  together  with  the  fact  that  Tf( m  -  j)  -  Tf( m)  =  0  for  all 
m  and  j  implies  that  Tf  is  Zn  periodic.  Now,  by  virtue  of  Lemma  3  Tf  is  a 
constant  and  hence 


(40) 


Akr/  =  o. 
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Formulas  (39)  and  (40)  contradict  the  fact  that  B  ^  0  and  thus  imply  the 
desired  result.  ■ 


An  immediate  consequence  of  Proposition  9  of  course  is  the  fact  that  any  so¬ 
lution  for  the  problem  of  cardinal  interpolation  for  Jk-harmonic  splines  is  unique. 
We  summarize  our  results  concerning  the  interpolation  problem  as  follows: 

Theorem  1  Ifv  =  j  in  Zn,  is  a  sequence  of  polynomial  growth  then  there 
is  a  unique  t-harmonic  spline  f  such  that  /(j)  =  t>j  for  all  j.  Furthermore,  if  v 
is  in  ya  then  f  is  in  SH?(Rn). 

Note  that  the  converse  of  the  theorem  above  follows  immediately  from  the  def¬ 
initions  and  results  in  Section  2. 

Theorem  2  Every  k-harmonic  spline  f  has  a  unique  representation  in  terms  of 
translates  of  Lk,  namely 

/(*)=  £  /(j)M*-j)- 

jez* 

We  conclude  this  paper  with  a  result  that  may  justify  the  use  of  the  adjective 
‘cardinal’  when  referring  to  these  splines.  For  the  univariate  case  see  [15]. 

Proposition  10  For  x  =  (*i , . . . ,  x„) 


Now,  for  j  ^  0  and  4  in  the  interior  of  Qn,  -  2wj|  >  |£|.  Hence,  for  such  £,  it 
is  clear  from  (42)  that 

(43)  lim  Lk(t)  =  (2 t)-"'j. 

t—oo 

To  see  what  happens  for  general  £’s  write,  by  virtue  of  the  periodicity  of  4>k, 

(44)  Lk(()  =  H(l3)-k*k((  -  2*j)  =  |  £*((  ~  2*j) 
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From  (44)  it  is  clear  that  for  £  in  the  complement  of  Qn 
(45)  Urn  Lk(0  =  0. 

k  —  oo 

Again  using  (44)  together  with  routine  estimates  shows  that,  whenever  2k  > 
n+1,  Li  is  dominated  by  an  integrable  function,  independent  of  k.  This  together 
with  (43),  (45),  and  the  dominated  convergence  theorem  imply  that  (2 x)"/2Lt 
converges  to  the  characteristic  (indicator)  function  of  Qn  in  Ll(Rn)  and  hence, 
the  desired  result  follows  by  taking  Fourier  transforms.  I 
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Solutions  of  Underdetermined  Systems  of 
Linear  Equations 

W.  R.  Madych* 


Abstract 

We  (i)  outline  a  general  framework  for  generating  solutions  to  un¬ 
derdetermined  systems  of  equations,  (ii)  review  properties  of  several 
specific  methods,  including  minimal  norm  and  maximum  entropy,  (iii) 
introduce  specific  alternate  methods  for  generating  non-negative  solu¬ 
tions,  (iv)  compare,  via  systematic  numerical  examples,  the  solutions 
generated  by  these  methods  with  those  generated  by  the  maximum 
entropy  and  minimum  norm  methods,  and  (v)  consider  the  nature  of 
the  positivity  constraint  by  studying  a  transparent  example. 

1  Introduction. 

This  study  is  an  attempt  to  obtain  some  understanding  of  the  nature  of  cer¬ 
tain  solutions  of  underdetermined  systems  of  linear  equations  with  a  view 
to  their  role  in  the  analysis  of  various  practical  inverse  problems,  specifically 
those  associated  with  image  restoration  and  computed  tomography.  For  ex¬ 
ample,  one  of  the  questions  we  are  interested  in  is  the  following:  under  what 
conditions,  if  any,  is  the  so-called  maximum  entropy  solution  better  than 
solutions  obtained  by  other  methods.  To  this  end  we  introduce  alternate 
methods  for  generating  non-negative  solutions  and  discuss  the  results  of  sev¬ 
eral  systematic  numerical  experiments. 

More  specifically  we  (i)  outline  a  general  framework  for  generating  solu¬ 
tions  to  underdetermined  systems  of  equations,  (ii)  review  properties  of  sev¬ 
eral  specific  methods,  including  minimal  norm  and  maximum  entropy,  (iii) 
introduce  specific  alternate  methods  for  generating  non-negative  solutions, 
(iv)  compare,  via  systematic  numerical  examples,  the  solutions  generated  by 
these  methods  with  those  generated  by  the  maximum  entropy  and  minimum 
norm  methods,  and  (v)  consider  the  nature  of  the  positivity  constraint  by 
studying  a  transparent  example. 

*1980  Math.  Subject  Classification  (1985  Revision).  62G05,  65D99.  Partially  sup¬ 
ported  by  a  grant  from  the  Air  Force  Office  of  Scientific  Research,  AFOSR-86-0145 


1 


In  this  paper  the  basic  issue  is  the  non-uniqueness  of  the  solution.  We 
mention  but  do  not  specifically  address  the  important  issues  of  noise,  ill¬ 
conditionedness,  and  efficiency  of  the  numerical  algorithms  used  to  imple¬ 
ment  the  various  methods  under  consideration. 

1.1  The  Basic  Setup. 

Consider  the  system  of  linear  equations 

n 

(1)  aijij  =  bi  ,  i  =  1, . . . ,  m. 

i=  i 

Here,  we  take  the  field  of  scalars  to  be  real.  Using  standard  matrix  notation 

(1)  may  be  expressed  as  a  collection  of  scalar  products 

(2)  ( di,x)=bi ,  i=  1, . . .  ,m, 

where  a ,•  =  (an, . . .  ,aj„)T,  x  =  (ij, . . .  ,xn)T  and  (a,-,  x)  =  afx;  or  even  more 
compactly  as 

(3)  Ax  =  b 

where  A  =  (a,j)  is  an  m  by  n  matrix  and  6  =  (6j, . . . ,  bm)T. 

In  what  follows  the  matrix  A  and  the  data  b  are  assumed  to  be  known. 
We  are  interested  in  the  set  of  solutions  to  (3),  namely  the  set 

Sa,6  =  {x  :  Ax  —  b}. 

To  avoid  complications  which  are  not  germain  to  the  questions  under  consid¬ 
eration  here,  we  always  assume  that  m  <  n  and  that  A  is  of  full  rank.  Thus 
Syi.i  is  not  empty;  indeed,  it  is  an  n  —  m  dimensional  affine  manifold  in  the 
real  Euclidean  space  Rn. 

1.2  Motivation. 

In  the  applications  we  have  in  mind,  namely  image  restoration,  computed 
tomography,  and  related  inverse  problems,  A  represents  the  mathematical 
model  or  a  discrete  analogue  of  the  data  aquisition  scheme  and  b  is  the 
measured  data. 

In  studying  such  models  many  considerations  must  often  be  taken  into 
account.  For  example,  in  certain  models  of  seismic  borehole  tomography  A 
is  rectangular  but  not  of  full  rank,  see  [5];  in  this  case  system  (3)  is  both  over 
and  underdetermined.  Another  complication  arises  in  problems  of  practical 
interest  by  virtue  of  the  fact  that  there  is  always  some  degree  of  uncertainty  in 
taking  physical  measurements.  Thus  in  many  instances  (3)  is  often  replaced 
with 

(4)  Ax  +  e  =  b 
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where  e  is  a  random  vector  which  represents  noise  and  has  certain  statistical 
properties,  see  [1],  [8],  [9],  [11).  In  view  of  the  fact  that  there  are  standard 
techniques  to  handle  the  above  complications  we  feel  that  taking  into  account 
such  considerations  here  will  unnecessarily  complicate  the  discussion  and 
cloud  the  main  issue  which  is  the  lack  of  uniqueness. 

Returning  to  the  problem  modeled  by  (3),  it  is  clear  that  the  desired 
quantity  is  a  solution  which,  unfortunately,  is  not  uniquely  determined  by 
the  measured  data.  In  fact,  the  set  of  feasible  solutions  Sa^  is  very  large 
indeed. 

Ideally,  if  one  could  constrain  the  feasible  set  of  solutions  appropriately, 
(3)  should  contain  enough  information  to  uniquely  determine  the  x  which 
gave  rise  to  the  data.  Of  course,  the  best  that  one  can  usually  expect  is  to 
obtain  a  reasonable  estimator. 

We  outline  some  general  methods  for  constraining  the  feasible  set  of  so¬ 
lutions  in  section  two.  In  the  third  section  we  consider  some  familiar  exam¬ 
ples,  specifically  the  minimum  norm  and  maximum  entropy  methods,  and 
introduce  some  new  methods.  Finally,  in  section  four  we  consider  the  conse¬ 
quences  of  certain  constraints,  particularly  the  constraint  of  componentwise 
positivity;  here  we  also  indicate  the  results  of  several  numerical  experiments. 

2  Restricting  the  Feasible  Set. 

There  are  many  procedures  for  restricting  the  solutions  of  (3).  In  this  paper 
we  consider  two  general  and  often  related  methodologies.  These  are  described 
below  together  with  a  familiar  example.  Details  of  how  they  are  related  are 
contained  in  subsection  2.3. 

2.1  Parametrization. 

One  method  is  to  assume  that  the  solution  of  (3)  is  of  a  certain  form.  Namely 

(5)  x  =  F(0 

where  £  =  is  contained  in  a  subset  of  Rk ,  call  it  V,  and  F  is  a 

mapping  of  V  into  a  subset  M  of  Rn.  Typically  the  set  V  is  an  open  subset 
of  Rk  and  the  mapping  F  is  one  to  one  and  continuously  differentiable;  in 
this  case  M  may  be  viewed  as  a  k  dimensional  submanifold  of  Rn.  We  will 
always  assume  that  this  is  the  case  and,  for  readily  transparent  reasons,  see 

(6)  below,  take  k  =  m.  Essentially  F  is  a  parametrization  of  the  manifold 
M. 

The  problem  now  reduces  to  finding  values  of  the  acceptable  parameter 
(  such  that 

(6)  AF(()  =  b. 
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If  if  is  any  solution  of  (6)  then  clearly  x  =  F(£)  is  in  the  intersection  of  M  and 
SA,b-  The  main  difficulty  with  this  approach  in  the  general  case  is  assuring 
that  the  form  (5)  is  such  that  (6)  has  a  unique  solution  for  every  b  which 
may  arise  in  a  given  application.  Furthermore,  except  for  certain  examples, 
it  is  difficult  to  determine  Ai,  let  alone  the  intersection  of  SA,h  with  M. 

One  classical  example  where  (6)  has  a  unique  solution  for  every  b  is  the 
case  when  V  is  Rm, 

(7)  x  ~  F{£)  =  £lOl  +  •  •  •  +  tmVm  =  AT£, 

and  M  is  the  linear  subspace  generated  by  <*i, . . . ,  am.  In  this  case  the  unique 
solution  of  (6)  is  given  by 

(8)  (-(AAT)-'b 

and  the  corresponding  solution  x  of  (3)  is  given  by 

(9)  x  =  AT{AAr)~lb. 

(We  remind  the  reader  that  A  is  assumed  to  have  rank  m  which  implies  that 
AAt  is  invertible.)  We  will  return  to  this  important  example  later. 

2.2  Optimization. 

The  other  general  approach  is  to  find  the  minimum  (or  maximum)  of  a  scalar 
valued  function  f(x)  defined  on  a  subset  K  of  Rn  subject  to  the  constraints 
imposed  by  (2).  In  other  words,  find  x  which  satisfies 

(10)  /(x)  =  min{/(y)  :  y  G  K.  n  5^}. 

Of  course  /  should  be  chosen  so  that  the  set  JCn  SA,b  is  not  empty  and  /  has  a 
unique  minimum  on  this  set.  Fortunately  by  choosing  /  with  certain  readily 
verifiable  properties,  for  instance,  convexity,  it  is  not  difficult  to  guarantee 
that  the  desired  conditions  are  satisfied. 

For  example  if  /  is  a  positive  definite  quadratic  form  on  K  —  Rn  then  it 
is  a  classical  fact  that  (10)  has  a  unique  solution,  see  [10].  In  the  special  case 

fix)  =  (x,  x) 

the  solution  is  known  as  the  minimum  norm  solution  of  (3)  and  is  given  by 
(9). 


2.3  A  connection. 

As  mentioned  earlier,  often  the  methods  of  parametrization  and  optimization 
are  related.  To  see  this,  assume  that  /(x)  is  continuously  differentiable  and 
formally  apply  the  method  of  Lagrange  multipliers  to  solve  problem  (10).  In 
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particular,  set  £  =  (£1, . . . ,  £m)r  where  the  &  are  the  ‘Lagrange  multipliers’ 
and  write 

(ii)  h({,  *)  =  /(*)  -  £  &((«.•» *>  -  bi )• 

»=i 

Taking  the  gradient  of  /i  and  setting  the  result  to  0  gives 


(flj,  x)  —  6;  ,  i  —  1 , . . . ,  m, 


and 


d/(») 

dij 


n 

—  52  &°*i  =  ®  >  i =  i>  • 

1=1 


n. 


The  first  set  of  equations  is  just  (2).  The  last  set  of  equations  can  be  written 
more  compactly  and  transparently  as 


(12) 


V/(x)  =  At( 


where  Vf  denotes  the  gradient  of  /.  If  V/  is  invertible  the  optimal  solution 
may  be  expressed  as 

(13)  x  =  G(AT0 

where  G  is  the  inverse  of  V/.  "finally,  equations  (2)  and  (13)  imply  that 
under  appropriate  conditions  the  solution  to  problem  (10)  is  given  by  x  of 
the  form  (13)  where  £  is  a  solution  of 

(14)  AG{ATi)  =  6. 

The  relationship  mentioned  above  should  now  be  clear.  Roughly  speak¬ 
ing,  if  F{Q  =  G(ATf),  where  G  is  the  inverse  of  Vf  then  the  two  methods 
should  give  rise  to  the  same  solution.  This  observation  is  useful  when  trying 
to  determine  whether  (5)  has  a  unique  solution  and  other  questions  related 
to  F. 

In  the  case  where  /  is  of  the  form 

(15)  /(*)  =  E/i(*;) 

y=i 

equation  (13)  is  particularly  simple  .  Namely,  it  can  be  expressed  as 

(16)  =  Sj((AT$);)  >  j  =  l,...,n, 

where  (AT£)j  denotes  the  j-th  component  of  AT£  and  g}  is  the  (univariate) 
derivative  of  fj.  Essentially  all  the  examples  below  are  of  this  form. 
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3  Examples. 

3.1  Minimum  norm  and  generalizations. 

As  indicated  earlier  the  minimum  norm  solution  of  (3)  is  the  solution  to 

problem  (10)  in  the  case 

(!7)  f(x)  = (x,x) 

Perhaps  a  more  accurate  description  would  be  the  minimum  quadratic  norm 
solution. 

Standard  variants  of  (17)  are  more  general  quadratics  which  include  /’ s 
of  the  form 

f(x)  =  q(C(x  -  y)) 

where  q(x)  =  (x,x),  C  is  an  n  x  n  matrix,  and  y  is  a  constant  vector.  The 
parameters  in  C  and  y  are  usually  chosen  to  influence  the  behavior  of  the 
solution.  Properties  of  such  solutions  are  well  known  and  well  documented, 
for  example  see  [2],  [3],  [10],  and  the  references  cited  there. 

Perhaps  the  most  important  feature  of  this  method  is  the  fact  that  the 
relationship  between  the  data  and  the  resulting  estimator  is  linear.  Besides 
being  a  convenient  theoretical  tool,  this  property  allows  for  efficient  compu¬ 
tational  algorithms  in  many  applications. 

3.2  Maximum  entropy. 

The  maximum  entropy  solution  of  ( 1 )  is  an  estimator  whose  components  are 
of  the  form 

(18)  xi  =  Pj  exp  ^  &a»> j  ,  j  =  1,  •  • . ,  n, 

where  p  =  (pj,.. . ,p„)r  is  a  constant  and  the  £,’s  are  parameters  chosen  so 
that  x  =  (ii,...,x„)T  satisfies  (1).  Using  the  notation  and  terminology  of 
subsection  2.1  this  form  can  be  expressed  more  compactly  as 

(19)  x  =  F(0  =  Pexp(AT£)  , 

where  P  is  the  constant  diagonal  matrix  with  diagonal  p  and  the  exponential 
is  interpreted  componentwise,  namely,  if  y  =  (y, , . . . ,  y„)T  then  exp(y)  = 
(exp(l/i ),-..,  exp(yn))T. 

Observe  that  in  this  case  the  manifold  M  is  contained  in  the  positive 
cone 

—  {x  :  Xj  >  0  ,  j  =  l,...,n}. 

Thus  it  should  be  clear  that  any  estimator  of  this  form  will  have  non-negative 
components. 
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The  parameter  p  is  chosen  to  influence  the  behavior  of  the  solution.  In 
the  discussion  below,  unless  indicated  otherwise,  we  always  assume  the  com¬ 
ponents  of  p  to  be  one. 

Observe  that  the  manifold  M  can  be  described  so  that  in  low  dimensional 
examples  it  is  relatively  easy  to  visualize.  For  example,  in  the  case  m  =  2, 
n  =  3,  if  the  last  column  of  A  is  a  linear  combination  of  the  first  and  second 
with  coefficients  ax  and  a2  respectively,  then  M  may  be  described  by 

M  =  {x  :  xx  >  0  ,  x2  >  0  ,  X3  =  xaixaj  }. 

In  the  general  case,  if  A  is  such  that  the  first  m  columns  are  linearly  in¬ 
dependent,  and  the  components  of  x  can  always  be  permuted  so  that  the 
resulting  system  of  equations  has  this  property,  then  M  is  the  intersection 
of  the  manifolds  M ,,  i  =  1, . . . ,  n  —  m,  where 

Mi  =  {x  :  xx  >  0  , . . . ,  xm  >  0  ,  xm+i  =  x"*1  •  •  •  x",m  }. 

and  the  a,/s  are  appropriate  constants. 

It  is  not  difficult  to  see  that  the  resulting  estimator  may  also  be  viewed 
as  the  solution  of  the  minimization  problem  (10)  with 

(20)  f(x)  =  X>,  log  , 

j= i  \ePj) 

where  log  is  the  natural  logarithm  with  base  e  and  the  constants  pj  are  those 
in  (18).  As  suggested  in  subsection  2.3,  an  immediate  consequence  of  this 
formulation  is  the  fact  that  if  the  solution  hyperplane  SA,b  intersects  the 
positive  cone  R "  then  SA<t>  intersects  the  manifold  parametrized  by  (19)  at 
exactly  one  point.  In  other  words,  if  R+  fl  SA,b  is  not  empty  then  (3)  has  a 
unique  solution  of  the  form  (19). 

Note  that  the  the  particular  normalization  of  /  in  (20)  results  in  x  =  p 
as  the  optimal  solution  in  the  case  of  no  contraints. 

It  should  be  mentioned  that  the  maximum  entropy  solution  is  often 
viewed  as  «hat  estimator  which  maximizes  the  negative  of  an  expression 
similar  to  (20).  Thus  the  term  maximum.  The  rationale  behind  the  term 
entropy  is  discussed  in  [4]  and  [6]. 

In  view  of  the  fact  that  much  work  has  centered  around  this  method 
suprisingly  little  is  known  concerning  the  theoretical  properties  of  the  result¬ 
ing  estimators  beyond  the  immediate  consequences  of  the  definitions. 

One  interesting  fact  concerning  such  solutions  to  a  very  special  class  of 
linear  systems  has  been  given  in  [4]  and  [7].  These  systems  can  be  described 
as  follows:  Suppose  n  =  Ik  and  write  the  variable  x  =  (ii,...,xn)  in  a 
rectangular  array  as  shown. 

Xj  ...  Xfc 

(21)  :  : 

Xlk-k+ 1  •••  1 


7 


The  system  of  equations  then  is  simply  the  collection  of  row  sums  and  column 
sums  of  (21),  namely, 

^22)  X(i-1  )k+j  =  ri  5  1  =  1)  •  •  •  1  ‘i 

Si=l  x(i-l)k+j  =  Cj  )  j  =  1)  •  •  •  ) 
where  each  row  and  column  sum  is  positive  and 

ri  + - h  r,  =  1 

Ci  +  •  •  •  +  Cfc  =  1  . 

For  this  system  the  maximum  entropy  solution  is  given  by 

(23)  =  T{Cj  . 

In  other  words,  the  value  of  each  component  is  the  product  of  the  row  and 
column  sums  which  contain  it. 

The  setup  involving  (21),  (22),  and  (23)  has  the  following  probabilistic 
interpretation.  If  the  x/s  represent  the  probabilities  of  certain  basic  events 
Wj,  j  =  l,...,n,  then  the  sums  in  (22)  represent  the  probabilities  of  the 
unions, 

Pi  =  U*_1w(,_i)fc+j,  t  =  1,...,/  and  7_,  =  u|=1w(,_d*+j,  j  =  1, . . . ,  k. 

Formula  (23)  expresses  the  fact  that  Pi  and  jj  are  mutually  independent 
events  in  the  probabilistic  sense.  This  interpretation  is  valid  only  for  systems 
of  the  type  described  by  (22);  presently  there  are  no  analogous  results  for 
more  general  systems. 

3.3  Methods  for  generating  bounded  solutions. 

In  this  subsection  we  introduce  two  alternate  methods  for  generating  so¬ 
lutions  which  are  bounded  componentwise  based  on  the  generalities  in  the 
second  section. 

Observe  that  it  suffices  to  restrict  our  attention  to  those  methods  which 
generate  estimators  which  are  in  the  positive  cone  since  the  change  of 
variables  x  — >  i  —  y  will  easily  transform  such  a  method  to  one  which  gen¬ 
erates  estimators  which  are  bounded  componentwise  from  below  by  y.  A 
similar  remark  holds  concerning  boundedness  from  above. 

If  £  =  (£i, . . .  ,£m)r,  —  oo  <  <  oo,  t  =  1, . . . ,  m,  consider  the  parametriza- 

tion  given  by 

(24)  x}  =  i  {{AtOj  +  +  4}  ,  j  =  1,  •  •  • ,  n, 
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where  (AT£)j  denotes  the  j-th  component  of  AT£.  This  parametrization  can 
be  expressed  more  compactly  by  the  formula 

(25)  x  =  *(ATt)  , 

where  if  y  =  (yu . . . ,  yn)T  then  the  j-th  component  of  $  is  given  by 

$;(»/)  =  \  {Vi  +  \Jv]  +  4}  ,  j  =  1, .  •  • ,  n. 

Observe  that  if  Ad#  denotes  the  manifold  parametrized  by  (24)  then  Ad# 
is  contained  in  the  positive  cone  72+ .  Thus  any  solution  of  (3)  which  enjoys 
the  representation  (24)  must  have  non-negative  components. 

Proposition  1  If  the  intersection  of  S4i&  and  72+  is  not  empty  then 

(26)  A$(AT£)  =  b 

has  a  unique  solution  £.  In  other  words,  Ad#  fl  contains  exactly  one 
element  x  =  $(AT£). 

Proof  Consider  the  scalar  function  /  defined  on  R+  by  the  formula 

(27)  f(x)  =  £  ^y-logx,^  . 

It  should  be  clear  from  the  definition  of  /  that  there  is  a  unique  optimal  x 
which  minimizes 

{/(x)  :  x  G  S4, b  n  Rl  } 

in  72".  Using  the  chain  of  reasoning  outlined  in  subsection  2.3  it  is  apparent 
that  such  an  x  satisfies 

V/(x)  =  ATi 

for  a  unique  £.  Since  $  is  the  inverse  of  V/  we  may  write 

x  =  $(At£) 


and  the  desired  result  follows. 


For  another  example  consider  the  relation 


(28) 


for  positive  numbers  t.  Since  the  right  hand  side  of  (28)  is  an  increasing 
function  of  t  it  is  evident  that  (28)  defines  a  function  rf(s)  mapping  0  < 
s  <  oo  onto  — oo  <  t  <  oo.  Note  that  if(s)  is  a  root  of  the  polynomial 
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t 4  —  st3  —  1.  Now,  using  roughly  the  same  notation  as  in  (25),  we  define 
another  parametrization  by  the  formula 

(29)  x  =  (Ar£) , 

where  the  j-th  component  of  $  is  given  by 

Vj(y)  =  i’(Vj)  »  j  =  1, 

and  ip  is  the  function  defined  earlier  in  this  paragraph. 

It  is  not  difficult  to  see  that  everything  that  was  said  concerning  $  also 
holds  for  Indeed,  we  may  state  the  following. 

Proposition  2  Proposition  1  remains  true  if  $  is  replaced  by 't. 

Proof  Recall  the  proof  of  Proposition  1.  If  we  simply  replace  (27)  by 

PO)  =  + 

the  rest  of  the  proof  of  this  proposition  is  the  same  as  that  of  Proposition  1. 


A  direct  consequence  of  the  above  propositions  are  two  methods  for  gener¬ 
ating  estimators  for  (3).  For  future  reference  we  will  refer  to  them  as  method 
one  and  method  two. 

4  Numerical  experiments  and  comments. 

Recall  that  the  estimators  generated  by  the  method  of  minimum  norm  are  lin¬ 
ear  functions  of  the  data.  Furthermore  there  are  a  host  of  efficient  algorithms 
for  computing  them,  see  [2]  and  [10].  On  the  other  hand,  the  estimators  gen¬ 
erated  by  the  other  methods  mentioned  above  depend  non-linearly  on  the 
data  and,  as  is  readily  evident,  are  considerably  more  difficult  to  compute. 
Thus  understanding  the  nature  of  these  estimators  and  their  relative  merits 
is  of  some  practical  significance. 

4.1  Description  of  numerical  experiments. 

To  obtain  a  sense  of  the  nature  of  the  estimators  generated  by  the  methods 
outlined  in  section  3  we  performed  numerical  experiments  on  relatively  small 
linear  systems.  The  systems  considered  were  of  the  form 

1  k~l 

(31)  —  )  ^  =  bj  ,  i  =  1 , . . . ,  m, 

*  ;=0 
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where  k<n,  m=-n  —  k  +  1,  and  n  is  the  number  of  variables  xj.  System 
(31)  is  a  typical  example  of  a  one  dimensional  blurring  model.  The  sizes 
considered  for  our  experiments  ranged  from  m  =  15,  n  =  20  to  m  =  80, 
n  =  100  with  the  ratio  m/n  varying  between  0.5  and  0.9.  The  experiments 
were  performed  as  follows: 

A  non-negative  pseudo- random  vector  x  =  (xl5 . . . ,  xn)T  was  generated 
via  a  canned  subroutine  and  the  data  b  =  Ax  was  computed.  Then  each  of 
the  methods  outlined  in  section  3  was  used  to  generate  an  estimator.  We 
refer  to  these  method  as  minimum  norm,  maximum  entropy,  method  one,  and 
method  two  or,  more  briefy,  MN,  ME,  Ml,  and  M2  respectively.  Formula 
(9)  was  used  to  compute  the  MN  estimator.  The  other  estimators  were 
computed  by  using  Newton’s  method  to  solve  (6)  for  £  and  then  using  (5) 
to  evaluate  the  corresponding  estimator  x.  In  the  case  of  maximum  entropy 
the  values  pj  =  1,  j  =  l,...,n,  were  used.  The  resulting  estimators  were 
plotted  together  with  the  true  phantom  x.  In  each  case  the  error 


l|x  — 


1/2 


was  computed. 

The  results  of  these  experiments  can  be  loosely  described  as  follows: 

When  the  lower  bound,  zero  in  this  case,  was  not  a  tight  one  for  the  phan¬ 
tom  then  all  the  methods  generated  estimates  which  were  roughly  equivalent. 
Namely,  they  differed  from  one  another  but  the  differences  were  judged  not 
significant.  The  computed  error  varied  but  was  roughly  the  same  order  of 
magnitude  for  all  the  methods.  For  example,  see  Figure  1;  here  m  =  19, 
n  =  24  and  the  components  of  the  phantom  x  are  uniformly  distributed 
between  0  and  1. 

On  the  other  hand,  when  the  lower  bound  for  the  phantom  was  reasonably 
tight  then  the  methods  which  enforced  the  lower  bound  generated  consider¬ 
ably  better  estimators.  Indeed,  the  computed  errors  for  estimators  generated 
by  ME,  Ml,  and  M2  were  significantly  smaller  than  the  error  for  the  estima¬ 
tor  generated  by  MN.  The  estimators  generated  by  ME,  Ml,  and  M2  differed 
but  the  difference  was  judged  not  significant;  the  same  was  true  of  the  cor¬ 
responding  computed  error.  For  example,  see  Figure  2;  here  again  m  =  19, 
n  =  24  but  the  components  of  the  phantom  x  are  distributed  according  to 
the  1/4-th  power  of  the  uniform  distribution  between  0  and  1. 

Similar  experiments  were  performed  on  systems  of  the  form 

v-'  2vij  , 

V x  cos - ,  »  =  0,...,fr, 

n 


E 


j=i 


.  2nij 

x,  sin - 

n 


i  =  1 
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where  m  =  2k  4-  1  and  m  significantly  less  than  n.  Here  the  results  were 
roughly  the  same  as  those  reported  above,  although  in  the  cases  when  the 
lower  bound  was  tight  on  the  phantom  the  differences  seemed  less  dramatic. 

4.2  Comments. 

To  obtain  some  perspective  on  the  observations  recorded  in  the  previous 
subsection  consider  the  system  given  by 

(32)  xi  +  X2  =  e  and  x2  +  xz  =  1 

where  e  is  a  small  positive  number.  In  this  case  SAib  is  simply  the  line  in  B? 
parametrized  by 


x  =  (e  —  t,  t,  1  —  <)  ,  — oo  <  t  <  oo. 

Suppose  that,  in  addition  to  (32)  we  know  that  the  phantom  which  gave  rise 
to  the  data  had  non-negative  components.  Namely, 

(33)  Xt  >  0,  ,x2  >  0,  x3  >  0. 

It  is  then  clear  that  with  this  additional  information  the  feasible  set  of  so¬ 
lutions  is  that  part  of  SAth  contained  in  a  ball  of  radius  \/3e/2  centered  at 
(e/2,  e/2, 1  -  (e/2)).  Thus  any  non-negative  solution  of  (32)  will  be  within 
\/3e  of  the  desired  phantom.  Indeed,  if  e  =  0,  then  (32)  together  with  (33) 
imply  a  unique  solution. 

The  principle  illustrated  by  the  above  simple  example  is  no  doubt  valid 
for  much  larger  and  more  complicated  systems  of  equations.  The  extent  to 
which  this  principle  is  valid  depends  on  the  matrix  A  and  the  phantom  x  and 
should  be  possible  to  characterize  quantitatively  in  terms  of  these  parameters. 
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Multivariate  Interpolation  and 
Conditionally  Positive  Definite  Functions  II 

W.  R.  Madych*  and  S.  A.  Nelson! 

Abstract.  We  continue  an  earlier  study  of  certain  spaces  that  provide  a  variational  framework 
for  multivariate  interpolation.  Using  the  Fourier  transform  to  analyze  these  spaces,  we  obtain 
error  estimates  of  arbitrarily  high  order  for  a  class  of  interpolation  methods  that  includes 
multiquadrics. 


1.  Introduction.  This  paper  continues  a  study,  [11],  of  certain  subspaces  Ch  of  C(Rn), 
the  continuous  complex  valued  functions  on  n-space  Rn.  The  spaces  Ch  provide  a  vari¬ 
ational  framework  for  the  following  interpolation  problem:  given  numerical  values  at  a 
scattered  set  of  points  in  Rn,  make  a  good  choice  of  a  function  /  in  C(Rn)  that  takes  on 
those  values. 

For  the  reader’s  convenience  we  review  some  basic  features  of  the  development  in  [11]. 
The  starting  point  is  the  selection  of  an  integer  m  >  0  and  a  continuous  function  h  on  Rn 
that  is  conditionally  positive  definite  of  order  m.  For  example:  m  =  1,  h(x)  =  — -y/1  -f-  [x[2. 
Using  h,  a  space  Ch  with  a  semi-inner  pr&duct  (  ,  )*  is  constructed.  Ch  is  a  subspace  of 
C(R"),  and  the  null  space  of  (  ,  )*  is  Pm-i,  the  polynomials  on  R"  of  degree  m  —  1  or 
less.  A  key  property  of  Ch  is  this:  if  xi,. . .  ,xjv  are  distinct  points  in  R"  and  vj, . . .  ,v,v 
are  complex  numbers,  then  among  all  functions  /  in  Ch  that  satisfy  the  interpolation 
conditions  /(x^)  =  u,,  the  quadratic  [[/)[£  =  (/,/)*  is  minimized  by  a  function  of  the  form 
/  =  s  +p  where  p  is  in  Pm-i  and 


(1-1) 


N 

s(x)  =  ^2  Cih(x  -  Xi) 

i=i 


with  c>xf  =  0  f°r  lal  <  m-  F°r  the  example  mentioned,  (1.1)  is  a  multiquadric 
intcrpolant. 

Because  the  spaces  Ch  are  translation  invariant,  the  Fourier  transform  is  a  natural  tool 
for  analyzing  them;  it  plays  a  central  role  here.  To  clarify  basic  ideas  and  make  an  orderly 
division  of  our  results,  we  avoided  Fourier  techniques  in  [11].  We  did,  however,  rely  on 
them  in  our  earlier  investigation  [10],  which  was  in  fact  prompted  by  the  Fourier  methods 
in  Duchon  [5].  Use  of  Fourier  transforms  allows  us  to  give  improved  descriptions  of  the 
spaces  Ch  (see  Section  3)  and  allows  us  to  single  out  certain  cases  where  error  estimates  of 
order  t  >  m  are  possible  (see  Section  4).  These  estimates  apply  to  the  multiquadric  case 
as  well  as  to  related  examples  given  in  Section  5;  for  each  example  given  there,  the  integer 
C  can  be  arbitrarily  large. 

•Department  of  Mathematics,  University  of  Connecticut,  Storrs,  CT  06268.  Both  authors  were  partially 
supported  by  a  grant  from  the  Air  Force  Office  of  Scientific  Research,  AFOSR-86-0145. 
tDepartmcnt  of  Mathematics,  Iowa  State  University,  Ames,  IA  50011. 


2.  Preliminaries.  In  this  section  we  recall  some  notation  and  results  involving  Fourier 
transforms  and  conditionally  positive  definite  functions. 

Let  X>(Rn)  denote  the  space  of  complex  valued  functions  on  Rn  that  are  compactly 
supported  and  infinitely  differentiable.  The  Fourier  transform  of  a  function  p  in  V  is 

(2.1)  £(0  =  J  e~t(x'^p{x)dx. 

In  order  to  make  use  of  theorems  from  G  elf  and  &  Vilenkin  [7]  we  adopt  their  definition  of 
?72-th  order  conditional  positive  definiteness.  (Equivalence  with  the  definition  used  in  [11] 
can  be  seen  from  Proposition  2.4  and  Theorem  6.1  below.)  Thus  for  a  continuous  function 
h  we  assume 

(2.2)  J  h(x)p  *  p(x)dx  >  0 

holds  whenever  p  =  p(D)tp  with  ip  in  2?  and  p(D)  a  linear  homogeneous  constant  coefficient 
differential  operator  of  order  m.  Here  p(x)  =  p(—x)  and  *  denotes  the  convolution  product 

P>\  *¥’a(0  =  J 9i(*)V2 (t-x)dx. 

Note  that  (2.2)  cam  be  rewritten  as 

(2.3)  JJ  h(x  -  y)p(x)p(y)dxdy  >  0. 

The  following  result  cam  be  found  in  Chapter  II,  Section  4.4  of  [7];  we  incorporate  a 
remark  at  the  end  of  that  section  concerning  the  case  where  h  is  continuous. 

Theorem  2.1.  Let  h  be  continuous  and  conditionally  positive  definite  of  order  m.  Then 
it  is  possible  to  choose  a  positive  Borel  measure  p  on  R"  ~  {0},  constants  a7,  |7|  <  2m 
and  a  function  \  in  V  such  that:  1  —  \(0  has  a  zero  of  order  2m  4-  1  at  £  =  0;  both  of  the 
integrals  f  |£|2md^(£),  f  dp(£)  are  finite;  for  all  ip  €  V, 
o<l€l<J  l€l>i 

(2.4)  f  h(x)rP(x)dx  =  [  [£«)  -  x(0  E  W(0)^]dM(O+  E 

J  J  |7l<2m  7'  hl<2m  7’ 

This  uniquely  determines  the  measure  p  and  the  constants  a7  for  |-y|  =  2m.  In  addition, 
for  every  choice  of  complex  numbers  ca,  |a|  =  m, 

(25)  E  E 

|or|  =  m  |/J|  =  m 

The  choice  of  \  affects  the  value  of  the  coefficients  a7  for  |'y|  <  2m.  Note  that  the  value 
of  the  right  side  of  (2.4)  does  not  change  if,  for  suitable  p,  \  is  replaced  by  \  +  p  and  the 
a-,,  for  |7|  <  2m,  are  replaced  by  a7  +  / p(0(ydp(£). 


As  can  be  seen  from 


(-i)hl  j x'<p(x)dx  =  D‘'ifi{ 0), 


changing  a  coefficient  a1  on  the  right  hand  side  of  (2.4)  corresponds  to  changing  h(x)  on 
the  left  side  by  adding  a  constant  multiple  of  x7. 

For  m  =  0,  (2.4)  reduces  to  f  hip  =  f  ipd\  where  A  is  the  Borel  measure  on  Rn  given  by 

\(E)  =  fi(E  ~  {0})  +  a06(E). 

Here  6  is  the  measure  corresponding  to  a  unit  mass  at  the  origin;  6(E)  =  1  if  0  €  E  and 
6(E)  =  0  otherwise.  Recall  that  Borel  measures  that  axe  finite  on  compact  sets  axe  called 
Radon  measures.  We  make  the  usual  identification  of  a  Radon  measure  on  an  open  set 
Q  C  Rn  with  the  corresponding  distribution  in  £>'(Q)  and  write  (A ,ip)  =  J  ipd\.  Also,  if 
/  €  £ioC(Rn)  we  identify  it  with  the  distribution  in  V  given  by  (/,  ip)  =  f  ip(x)f(x)dx. 
Thus,  for  m  =  0,  (2.4)  says  (h,<p)  =  (A ,£). 

For  an  illustration  of  the  theorem  when  m  ^  0,  take  n  =  2,  m  =  1,  h(x)  =  —y/l  4-  |x|2. 
Then  d/i(£)  =  w(£)d£  with 

w  (2*m 

and  a7  =  0  for  (-y |  =  2.  If  x  is  even,  then  the  coefficients  a7  for  |-y |  =  1  axe  also  0. 
The  remaining  coefficient  is  cto  =  —  (l  +  /  [1  —  x(f)l  w(0^)-  Details  for  this  and  related 
examples  are  given  in  Section  5. 

We  use  Tkip  to  denote  the  k- th  order  Taylor  polynomial  for  about  0: 

(2.7)  rV(0  =  £  d°V(o)^. 

M<* 

The  integral  on  the  right  side  of  (2.4)  can  then  be  written  as  f  ip  —  xT2m~1ipd/j.. 

The  Schwartz  space  of  rapidly  decreasing  C°°  functions  and  its  dual,  the  space  of  tem¬ 
pered  distributions,  are  denoted  by  the  usual  letters  S  and  S’. 

Proposition  2.2.  Let  k  be  a  positive  integer  and  let  o  be  a  Radon  measure  on  R"  {0} 
such  that  /|£j*(l  +  |£|k)  *dM(0  <  oo.  Let  s  be  a  continuous  function  such  that  |£|ks(£) 
is  bounded  on  R”  and  1  —  s(£)  =  0  (|£(k)  at  £  =  0.  Let 


«<*)-  /[*-«*•«> -»({)E^' 

J  r=0 


d°(Z). 


Then  u  6  C(Rn),  u(x)  =  o  (|x|*)  as  |x|  — ►  oo  and  for  all  tp  in  S 


J  u(x)<p(x)dx  =  J  ($  —  sTk  1<p)do. 
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PROOF:  Let  E(t)  =  e  **  —  53jLo(~ *<)r/r!  and  note  that  u  =  uq  where 

ua(*)=  f  (1  -  «(0)  +  s{Z)E{(x,Z))dcr{0- 

l€l>a 

From  |E(0I  <  |f|*  we  have  |s(f)i?({x,f))  |  <  |z|*|£|*|s(£)|.  Our  assumptions  on  a  and  s 
ensure  that  1  —  s(£)  and  |4I*IS(€)I  belong  to  L1^).  Continuity  of  u  can  be  established 
using  dominated  convergence. 

To  prove  u(x)  =  o  (|a:|fe)  note  that  juo(x)  —  u0(*)|  <  (ci(a)  +  C2(a)Jx|*)  where  ci(a)  and 
02(a)  are  the  results  of  integrating  |1  —  s(f)|  and  |f|*|s(£)|  over  0  <  |f|  <  a  with  respect 
to  |cr| .  Given  e  >  0,  choose  a  >  0  so  that  Cx(a)  <  e  and  02(a)  <  e.  From  |JE(t)|  <  2|<|fc'1 
and  a  >  0  we  have  u„(x)  =  O  (|x|*-1)  as  |x|  — ►  00.  Thus  we  may  choose  R  >  1  such  that 
| ua (x) |  <  e|x|*  for  all  |x|  >  R.  Then  for  |x|  >  R , 

|u(x)|  <  |ua(x)|  +  |uo(x)  -  ua(x)|  <  e|x|*  +  e  +  £|x|*. 

It  follows  that  u(x)  =  0(1x1*). 

To  establish  (2.9),  apply  Fubini’s  theorem  and  use 

j  ti^Qlv{x)dx  =  £  DV(0)g. 

|o|=r 

This  can  be  verified  by  using  (l/i  +  •  •  •  4-  y„)r/r\  =  £3  y° /»!  and  (2.6).  | 

|or|=r 

If  u  is  defined  by  (2.8)  with  a  =  p,  k  =  2m  and  s  =  then  from  (2.4),  (2.9)  and  (2.6) 
we  have  { h  —  u,xl>)  =  { q ,i/>)  for  all  t />  in  V.  Here  g(x)  =  £  a7(— ix)7/ 7!. 

|7|<2m 

Corollary  2.3.  Suppose  h  is  continuous  and  positive  definite  of  order  m.  If  m  >  0  then 
there  are  unique  constants  ay,  |-y|  =  2m  such  that  h(x)  —  53|7|=2m  a7(— ix)y/~f\  =  o  (|x|2m), 
as  |x|  — ►  00.  These  constants  are  the  same  as  those  appearing  in  (2.4). 

For  ease  in  dealing  with  (2.5),  we  develop  some  related  notation.  Let  Vm  be  the  space 
of  vectors  v  =  (v0)|a|=m  and  let  A  be  the  operator  on  Vm  defined  by  Av  =  w  where 
wa  =  53  Aa  pvp  and  Aaj  =  aa+0/(a\0\).  Because  of  (2.5)  A  must  be  real  symmetric. 
I0l="»  '  _ 

Tims  .4u  =  0  iff  vT Av  =  0.  Equivalently,  the  null  space,  Na,  of  A  is  the  null  space  of  the 
semi-inner  product  ( v,w)a  =  vTAw.  Let  Ha  —  Vui/Na  be  the  Hilbert  space  obtained  by 
identifying  v  and  w  whenever  |jt;  —  tr||^  =  0.  The  elements  of  Ha  are  the  cosets  v  +  Na 
and  as  w  varies  over  such  a  coset,  Aw  remains  fixed. 

By  applying  Theorem  2.1  we  can  recover  (2.2)  for  a  more  convenient  set  of  functions  <p. 
Let 

(2.10)  Vm  =  |i £T>  :  j  x°y?(x)dx  =  0  for  all  |a|  <  m  j. 
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Clearly,  Vm  =  {ip  £  V  :  <p(f)  =  0(|£|m)  at  £  =  0}.  If  0  =  p  *  p  then  r\>  =  \<p\2  so 

Q+t 3=7 


Hence,  for  0  =  <p  *  p  with  tp  £  Vm, 


(2.11) 


E  =  E  E  a°+e 

|7|<2m  |ar|=m 


Dap( 0)  D^p(0) 

a!  0\ 


where  is  the  vector  v  in  Vm  given  by  va  =  Da<p( 0).  From  (2.4)  we  see  that  if 

<p  £  Vm  then 

(2.12)  J  h(x)<p  *  <p(x)dx  =  J\^  +  mfA. 

and  (2.2)  holds.  Since  T>m  includes  the  functions  <p  for  which  (2.2)  was  assumed,  we  con¬ 
clude  that  requiring  (2.2)  for  all  <p  £  Vm  is  an  equivalent  definition  of  h  being  conditionally 
positive  definite  of  order  m. 

Since  X>m+1  C  T>m,  the  latter  definition  makes  it  clear  that  h  will  be  conditionally 
positive  definite  of  order  m  +  1  if  it  is  conditionally  positive  definite  of  order  m.  If  m  is 
replaced  by  m  +  1  in  Theorem  2.1,  with  h  held  fixed,  the  measure  p  will  remain  the  same, 
the  coefficients  a7,  }-y)  =  2(m  4-  1)  will  be  0  and  the  lower  order  coefficients  will  change  to 
reflect  changes  in  \  and  additional  terms  in  the  Taylor  polynomial. 

In  order  to  apply  results  from  [11]  we  verify  that  h  is  in  the  space  Qm(R")  defined  there. 

Proposition  2.4.  Let  h  be  continuous  and  assume  (2-2)  holds  for  all  p  £  T>m.  If 
Xi , . . . ,  xn  are  distinct  points  in  R”  and  Cj, . . . ,  cjy  are  constants  that  satisfy  ^i3Sl  c,xf  =  0 
for  all  |a|  <  m,  then 


C2.13) 


s 

E  CiC}h{xi  -  Xj)  >  0. 

<u=i 


PROOF:  Choose  g  in  T>  with  /  g(x)dx  =  1  and  g(x)  =  0  for  all  |i|  >  1.  For  e  >  0, 
let  g€  =  e~ng{x/e )  and  take  pe{x)  =  Y,k=i  ck9e{*  ~  **)•  Then  9^(0  =  t(0?(‘0  w»th 
r(0  =  £*Li  From  =  Ef=i  ck{-ixk)ae-'{zk •*>  we  find  r(£)  =  0(|£|m) 

at  £  =  0.  Thus  ipe  €  Vm  and 


0<  J  h(x)pe*<pe(x)dx  =  II  h(t  -  y)<pe(t)<pe(y)dtdy. 


Letting  j-*0we  obtain  (2.13).  | 

The  following  observations  will  be  used  in  the  next  section.  Let  Vm  =  {p  :  p  £  T>m}. 
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Proposition  2.5.  Let  m  >  0  and  let  p  be  a  positive  Borel  measure  on  Rn  ~  {0}  that 
satisfies  filer /(l +  \tn)*dp(0  <  oo.  If2k>m  then  T>2 k  is  a  dense  subset  of  L2(p). 

PROOF:  Let  g  E  L2{p)  and  e  >  0.  Choose  gi  E  Z>(Rn  ~  {0})  so  that  ||<?  —  || z.2(/x)  <  £- 

Then  /(£)  =  |£|-2*<7i(£)  is  in  V.  Since  V  is  dense  in  S  we  can  find  ip  EV  so  that  for  all  £ 
in  Rn,  |/(0  -  ^(01  <  £/  (1  +  |f|2fc).  Multiplying  by  |£|2t  gives 

M0  -  l«”*l  S 

Let  <p  =  (—A )kxp.  Then  <p  E  £>,  <£(£)  =  |£|2*^(£)  and 

J  fa  -  £i2^  ^ £2  /  mo- 

Thus  || g  —  can  be  made  as  small  as  desired  with  p  E  X>2Jt  •  I 

Proposition  2.6.  IfTEV  satisfies  T(<p)  =  0  for  all  ip  in  Dm  then  T  belongs  to  Pm-i- 

PROOF:  Define  Ta  E  V  by  Ta(p)  =  f  xa<p(x)dx  and  note  that  n{^cT1(0)  :  lal  <  m}  = 
T>m.  By  assumption,  Vm  is  contained  in  T-1(0),  the  null  space  of  T.  It  follows  (see 
Theorem  1.3  of  [9])  that  there  are  constants  ca  such  that  T  =  ca,Ta-  I 

|or|<m 

3.  Fourier  Description  of  C/,.  After  analyzing  the  space  C*,m  defined  below,  we  will 
see  that  it  coincides  with  the  space  Ch  studied  in  [11].  Among  the  results  emerging  from 
this  analysis  is  a  Fourier  transform  description  of  Ch,m- 

Definition.  Let  h  be  a  continuous  function  on  R"  that  is  conditionally  positive  definite 
of  order  m.  We  write  f  E  Cii,m(Rn)  if  f  E  C(Rn)  and  there  is  a  constant  c(f)  such  that 
for  all  <p  in  Vm 

(3.1)  |//(*Mx)dx  <c(f){jjk(x-y)p(x)p(y)dxdy) 

If  f  €  Ch  ,m  (Rn)  we  let  c.(f)  denote  the  smallest  constant  for  which  (3.1)  is  true. 

It  is  easily  checked  that  if  f\  and  /2  Eire  in  Ch,m  then  f\  +  /2  and  a/i,  a  E  C,  are  also  in 
Ch,m  with  c.(/i  +  /2)  <  c,(/i)  +  c.(/2)  and  c„(a/,)  =  |a|c.(/i).  If  /  E  Pm- i  and  <p  E  Vm 
then  {f,<p)  =  0  so  f  E  Ch,m  and  c,(/)  =  0.  Conversely,  if  c.(/)  =  0  then  /  E  Pm-i 
by  Proposition  2.6.  Thus  c,(f)  is  a  semi-norm  with  null  space  Pm_i;  for  m  =  0,  take 

p- 1  =  {0}. 

Using  (2.12)  we  note  that  (3.1)  is  equivalent  to 

(3.2)  |</,v)|  <  c(f)  {llvlli.,,,  +  »9<"',(0)||i},/2 
for  all  p  in  T>m.  If  v  6  Vm  and 

(3.3)  q(x)  =  Y,  ( Au)a(-i*)° 

|o|  =  m 
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then  (q,<p)  =  £  {Av)QDa$( 0)  =  ((^"^(O),!;)  .  so  9  e  Cfc.m  with  c,(g)  =  ||u||a-  If 

|aj=m 

g  6  L2(p)  and  u  is  defined  by  (2.8)  with  cr  =  gp,  k  =  m  and  an  appropriate  choice  of  s 
(take  s  =  0  for  m  =  0)  then,  for  <p  £  Vm,  (2.9)  gives  (u,ip)  =  f  <pgdp.  It  follows  that 
«  €  with  c,(u)  =  ||y|Us(/1). 

Clearly  Ch,m  includes  all  functions  of  the  form  /  =  u  +  q  -j-  p  with  u,  q  as  above  and 
p  £  Pm_i .  The  next  result,  when  combined  with  Proposition  2.6,  shows  that  all  functions 
in  Ch,m  can  be  obtained  in  this  way. 

From  the  behavior  of  u(x )  as  |x|  — >  00,  described  by  Proposition  2.2,  we  see  that  if 
m  >  0  and  /  =  u  +  q  +  p  *hen  /(x)  =  o(|xjm)  is  equivalent  to  q  =  0  (or  Av  =  0).  In  any 
case 

(3.4)  CA,m(R")  C  {/  £  C(Rn)  :  /(x)  =  0(|x|m)  as  |x|  -  00}. 

Proposition  3.1.  Let  m,  h,  p  and  ay  be  as  in  Theorem  2.1.  If  f  €  Chtm  then  there  is  a 
function  g  6  L2(p)  and  a  vector  v  £  Vm  such  that  for  all  <p  in  Vm 

(3.5)  {!,*)  =  /  $9  dp  +  53  (^)a-D“<?(0). 

J  \c\=m 

This  uniquely  determines  g  and  the  coset  v  +  NA. 

Proof:  Define  J  :  Vm  H  =  L2(p)  ©  A  by  Jy>  =  £  ©  (<^m)(0)  +  NA)  .  From  (3.2) 
we  see  that  |(/,y?)|  <  c,(/)||  J<p\\h-  From  this  we  deduce  that  if  Jipi  —  Jg>2  then  {f,<pi)  = 
(/,  (p2 )  •  It  follows  that  there  is  a  bounded  linear  functional  L  on  the  image  JVm,  such  that 
L(J<p)  =  (/,  <p)  for  all  ip  in  Vm.  Since  H  is  a  Hilbert  space,  we  can  choose  g  ©  (v  +  NA)  so 
that  for  all  ip  in  Vm  { f,<p )  =  ( J<p,g  ©(u  +  NA))H .  This  gives  (3.5). 

For  uniqueness,  we  show  that  JVm  is  dense  in  H .  Let  g\  £  L2(p),  w  £  Vm  and  17  >  0  be 
given.  Take  2k  >  m  and  use  Proposition  2.5  to  choose  p\  £  T>2k  with  Hgt  —  9i||l*(^)  <  P- 
Note  that  J<px  —  (p^  ©  0  since  2k  >  m.  Put  p(f)  =  ^  u;0^0/a!  and  take  x  €  T)  so 

|a|=m 

that  1  -  £(£)  =  0(j^jm+1)  at  £  =  0.  Define  tf>e  £  T>  by  05(<f)  = j>(Ox(£_1f  )•  Then 
7r/)e  =  0e  ©  (w  +  Na).  Choosing  e  close  enough  to  0,  we  have  <  p.  Then 

llffi  +(w  +  NA)  ~  J(<P  1  +  0«)||h  <  2r?.  | 

If  /  €  Ch,m  let  A  /  =  g  ffi(u  +  NA)  be  the  point  in  H  =  L2(p)@HA  determined  by  (3.5). 
Clearly  the  resulting  map  A  :  Ch,m  —>  H  is  linear.  That  A  maps  onto  H  is  evident  from  the 
remarks  leading  up  to  Proposition  3.1.  From  (3.2)  and  (3.5)  we  see  that  c,(/)  =  ||A/||//. 
Note  || A/ll//  =  {( f,f)h}l/ 2  =  \\f\\h  where  (fuf2)h  =  (A/i, A/2)h  is  a  semi-inner  product 
for  Ch.m •  There  is  a  corresponding  inner  product  on  Ch,m/Pm- 1  which  is  then  a  Hilbert 
space,  isomorphic  to  H  under  the  quotient  map  associated  with  A. 

The  following  provides  a  converse  to  Proposition  3.1  and  clarifies  how  the  Fourier  trans¬ 
form  relates  /  to  g,v  in  (3.5). 

Proposition  3.2.  Let  m,h,p  and  ay  be  as  in  Theorem  2.1.  Fix  g  £  L2{p),  v  £  Vm  and 
f  €  V .  The  following  are  equivalent: 

(a)  (3.5)  holds  for  all  <p  in  T>m, 
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(b)  f  £  S'  and  for  every  |a|  =  m,  faF  =  Xa  where  F  is  the  inverse  Fourier  transform 
of  f  and  Aa  is  the  Radon  measure  on  R"  given  by 


A c(E)  =  I  Cg(OMZ)  +  a! (Av)a6(E). 


£~{o} 

When  this  is  the  case,  f  G  Ch,m>  A/  =  g  ©  (v  +  NA)  and  ( /,/)/,  =  /  |<?|2dp  +  vT Av. 

PROOF:  Let  q  be  as  in  (3.3)  and  let  u  be  defined  by  (2.8)  with  a  —  gp ,  k  =  m  and  a  choice 
of  5  that  satisfies  the  hypotheses  of  Proposition  2.2.  If  (a)  holds  then  (/,  <p)  =  (u  +  q,p) 
for  all  <p  G  T>m.  By  Proposition  2.6  /  -  (u  +  q)  =  p  G  Pm-i-  If  F  =  f  and  «/>(£)  =  £°V(0 
then 

(ZaF,  <p)  =  (F,  $)  =  (/,  0)  =  (u,  t />)  +  (?  +  p, 


=  J  (t-sTm-ltygdn+  b°Daj(0) 


where  the  constants  ba  are  determined  by  q  +  p(x)  =  ba(ix)a-  Thus 

|or|<m 

(3.7)  (CF,  <p)  =  J  (fV(0  -  0)  gtiWti)  +  <*!(  Au)a<p(0) 

which  establishes  (b).  To  see  that  (b)  implies  (a),  let  /i  =  u  +  q  with  u  and  q  as  above. 
Then  (3.7)  holds  for  F\  where  F\  —  f\.  Hence  ( \aF\  =  A„.  If  (b)  holds  then  £aF\  =  £QF 
for  all  [o|  =  m.  This  implies  F\  -  F  —  £  baDa6  which  says  /i  -  /  6  Pm-\-  Therefore, 

jo|<m 

(a)  and  the  other  assertions  about  /  follow  from  the  corresponding  facts  about  f j.  | 

For  typical  choices  of  h  (e.g.  those  considered  in  Section  5)  the  measure  p  is  absolutely 
continuous  with  respect  to  Lebesgue  measure,  dp(£)  =  w(£)d£,  and  a7  =  0  for  all  |7|  =  2m. 
In  such  cases  the  measures  AQ  in  (3.6)  are  given  by  functions  Fa  in  L)1oc(Rn);  d\a(£)  = 
Fa(t)d£,  where  Fa{ 0  =  £ag(Z)w(£).  From  Daf  =  ((-iOaF)  =  {- i)mXa ,  we  see  that 
( Dafr=  (~i)m(2n)nFa  G  L}oc(Rn)  where  Fa(t)  =  Fa(- 0-  Let 

(3'8)  r(0  =  (27r )2r* !^!2t”u>(  i^) 

with  r(£)  =  oo  when  u>(— <f)  =  0.  If  dp(£)  =  r(£)d£,  then  (£>°r/)~G  L2(p)  and 

„  <  T\a  c\~\\7.  f  ¥Q\g(0\2  J 

II  (D  f)  II  LHp)  =  J  ■  |Y|2m  ~ 


•rfMO- 


Using  (4.2)  below  with  i  —  m, 

(3-9)  Y.  ^UDaf)llHp)  =  [  \g\2dp  =  (/,/)*. 

|o|=m  Q‘  J 

Corollary  3,3.  Let  m,h,p,  and  a7  be  as  in  Theorem  2.1.  Assume  dp(£)  =  w(£)d£  and 
(iy  =  0  for  all  (7)  =  2m.  Let  p  be  the  Borel  measure  on  R"  defined  by  dp(£)  =  r(£  )d<f  with 
r  as  in  (3.8).  Then  f  G  C&,m  iff  f  G  S'  and  (Da /)''£  L2(p)  for  every  |a|  =  m.  In  that  case 
(fJh  is  given  by  (3.9). 

The  translation  invariant  nature  of  C/,,m  is  evident  in  the  following. 
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Proposition  3.4.  Let  r  be  a  compactly  supported  Radon  measure  on  Rn.  If  f  is  in 
Ch,m  then  so  is  t  *  f .  Furthermore,  if  A  :  Ch,m  —*  L2(p)  ©  Ha  is  as  defined  above  and 
A/  =  g  ©  (u  +  Na )  then  A(r  *  /)  =  tg  ©  (t(O)v  +  Na)  where  t(£)  —  f  e^z’^dr(x). 

PROOF:  If  rp(x)  =  f  <p(x  +  y)dr(y )  then  (r  *  f,y>)  =  (/,  ip)  and 


(3.10) 


e  +  y)dxdr(y ) 

e-i<*-»’<)<p(z)dzdT(y)  =  (p(Z)t(0. 


If  A /  =  g  ©  (t>  +  iV^),  so  that  (3.5)  holds,  then  for  all  £  X>m 


(r  */,¥’)  =  f$gdp+  Y,  Da^(°)(Av)o, 

|o|=m 

=  f  ?tg  dp  +  J2  t(0)D°<p(0)(Av)Q. 


This  gives  (3.5),  with  f,g,v  replaced  by  r  *  /,  tg,  t(0)v;  the  assertions  made  are  now 
apparent.  | 

In  the  next  result,  (3.11)  is  equivalent  to  A(i/  *  h)  =  n  ©  (u;  -f  Na)  and  (3.12)  says 
"(/)  =  {v  *  h,f)k.  From  this  it  is  clear  that  Ch,m  satisfies  condition  (c)  in  Theorem  1.1 
of  [11],  That  conditions  (a)  and  (b)  are  also  satisfied  can  be  seen  from  the  discussion 
above  in  which  the  map  A  was  introduced.  Applying  Theorem  1.1  of  [11],  we  conclude 
that  Ch,m  =  Ch. 

Proposition  3.5.  Let  m,h,p  and  a7  be  as  in  Theorem  2.1.  Let  v  be  a  compactly  sup¬ 
ported  Radon  measure  on  Rn  and  assume  that  J  xadv{x)  =  0  for  all  |a|  <  m.  Then 
v  *  h  6  Ch,m  and  for  all  <p  in  Vm 


(3.11)  (i /*h,(p)=  f  ipndp  +  ^  (^u;)oZ?o(^(0) 

|o|=m 

where  n(£)  =  f  e,<r'^dz/(x)  and  wp  =  D0n{ 0)  =  f(ix)0dv(x).  Furthermore,  if  f  e  Ch,m 
and  A/  =  g  ©  (v  +  Na),  then 

(3.12)  J  f(x)di/(x)  =  J  ng  dp  +  wTAv. 

PROOF:  If  V>(z)  =  J <p(z  +  y)dv(y)  then,  from  (2.4), 

(3.13)  (v*h,y>)=  ,„0)  =  j  4>-xT2m-'$dp+  Y.  W(0)^ 

J  l7l<2m  7' 
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and,  as  in  (3.10),  $  =  (pn.  Clearly,  Dan(0)  =  0  for  all  |a|  <  m.  If  <p  £  Vm  then  D^(0)  =  0 
for  I7I  <  2m  and  for  |-y |  =  2m 

W(0)=  £  <>H>- 

a+0=-r 

Thus  (3.11)  follows  from  (3.13).  To  establish  (3.12)  choose  a  real  valued  function  r  in  P 
with  r(0)  =  1  and  for  £  >  0  let  <pe(x)  =  f  e~nr  (^*)  dv(y).  Then  <pc  £  T>m  and 

(/>V«)=  [&9dn+  Y  (Av)aDavl( 0). 

|or|=m 

This  yields  (3.12)  because  /  f(x)dv{x)  =  lim  (/,  <pe)  and  ^(£)  =  r(£f)n(£).  | 

For  s  as  in  (1.1)  we  have  s  =  u  *  h  with  f  pdv  =  YliLi  c,V?(x,).  Thus,  such  functions  s 
belong  to  Cfc>m. 

The  distribution  DKh,  |/c|  >  m  can  be  obtained  as  a  limit  of  u  *  h's  by  choosing  v's 
that  correspond  to  appropriate  difference  operators.  Such  i/’s  satisfy  the  orthogonality 
condition  /  xadu{x)  =  0,  |a|  <  m.  Hence  the  following  may  be  regarded  as  a  limiting  case 
of  the  situation  considered  above. 

Proposition  3.6.  Let  m,h,p  and  ay  be  as  in  Theorem  2.1.  Fix  k  with  |k|  >  m  and 
let  p(0  =  (*£)".  Then  p  £  L2(p)  iff  the  distribution  DKh  belongs  to  Ch,m ■  In  that  case 
A  ((-D)*h)  =  p  ©  (w  +  Na )  with  wa  =  Dap( 0),  |a|  =  m. 

PROOF:  Let  rp  =  DK<p  so  =  pip.  If  £  T>m  then,  by  a  calculation  like  that  for  (2.11), 


E  =  E  E  a°+e 

M<2m  ’’  |o|=m  |/?|  =  m 


T>ap(0)  DPp( 0) 

a!  /?! 


Using  (2.4),  we  have 


(3-14)  ((- D)*k,<p )  =  =  /  p<p</p  +  ^  (.4iy)pZ?^<p(0) 

for  all  1 p  £  Pm.  This  is  (3.5)  with  /  =  (~D)Kh,  g  =  p  and  v  =  w.  If  p  £  L2(p)  we  apply 
Proposition  3.2  to  see  that  /  £  Ch<m  and  A /  =  p  ©  (u.  +  jVA).  If  p  ^  Z2(p)  we  apply 
Proposition  2.5  to  obtain  a  sequence  p,  £  X>2 *  such  that  /  |<p,|2dp  =  1  and  f  ppidp  — ►  00. 
We  take  2k  >  m  so  that  l?^<pj(0)  =  0  when  |/?|  =  m.  Then  (3.14)  gives 

((- D)Kh,<pi )  =  J ppidp  -►  00. 

Since  +  ll9im)(0)llA  =  U  we  see  that  /  =  ( -D)Kh  cannot  satisfy  (3.2)  and  hence 

cannot  be  in  Ch,m •  I 
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4.  Error  Estimates.  In  this  section  we  derive  bounds  on  the  difference  between  a 
function  g  in  Ch,m  and  a  function  gx  of  minimal  Ch,m  norm  that  agrees  with  g  on  a  set 
X  C  R"  of  ‘interpolation  points’.  These  error  estimates  involve  a  parameter  that  measures 
the  spacing  of  the  points  in  X  and  are  of  order  £  in  that  parameter;  our  derivation  assumes 
£  >  m  and 

(4.1)  j  \tf‘dp(0<oo. 

For  the  examples  given  in  Section  5,  this  assumption  is  satisfied  for  arbitrarily  large  values 
of  £;  see  (5.2)  below.  In  particular,  the  estimates  apply  to  multiquadric  interpolation  since 
the  example  there  with  a  =  -1  gives  h(x)  =  -2^/7r(l  +  |x|2). 

Before  starting  on  the  error  estimates,  we  look  at  a  related  implication  of  (4.1).  Let 

Pa( 0  =  (i0°-  From 

(«)  («?  +  ■■•+£)'=  E 

M=<  ' 


we  observe  that  (4.1)  holds  iff  pa  6  L2(p)  for  all  |q|  =  £.  If  a  distribution  has  all  of  its 
£-ih.  order  derivatives  given  by  continuous  functions  then  it  will  belong  to  Cl( Rn).  Thus 
the  following  result  shows  that  (4.1)  holds  iff  Ch,m  C  C*(Rn). 

Proposition  4.1.  Let  m,  h,  p  and  a 7  be  as  in  Theorem  2.1.  Fix  a  with  jo)  >  m.  Then 
the  following  are  equivalent: 

(a)  pQ  e  L2(p),  where  pQ(0  =  (it)*; 

(b)  for  every  f  in  Ch<m,  the  distribution  Da  f  belongs  to  C(R")  and  there  is  a  constant 
cQ  such  that  for  all  f  in  Ch,m,  ||£Q/lloo  <  ca||/||k; 

(c)  there  is  a  point  xo  in  Rn  and  a  constant  c«  such  that  for  all  f  in  Ch  m  C 1  C°°, 

lD°f(x0)\  <  Ccll/IU. 

If  these  are  true,  then  for  all  f  £  Ck>m  and  all  y  G  Rn,  Da f{y)  =  (f,6y  *  (—D)ah)h. 

PROOF:  Let  /  €  Ch,m  and  let  F  be  its  inverse  Fourier  transform  so  that  F  —  f .  If 
\a\  =  m  then,  by  Proposition  3.2,  £°F  =  A„  with  AQ  given  by  (3.6).  If  |a|  >  m  then 
a  =  o'  -f  f)  with  |a'|  =  m.  Hence,  £aF  =  Aa  with  Aa  =  ^Aa<  where  Aa/  is  given  by  (3.6). 
If  (a)  holds  then  A0  is  finite;  for  ja|  =  m,  / d|AQ|  =  /  ^“^(01^(0  +  |(Au)0|  and  for 

|a|  >  m,  f  d|AQ|  =  f  \£ag{0\dp{0-  Thus  A0  is  continuous  and  bounded  by  f  d|Ac|.  Since 
( iD)af  =  (£°F)~=  A0  we  see  that  (b)  holds  with  cQ  =  ||pQ  ©  (pLm)(0)  +  jV^)||f/.  Thus  (a) 
implies  (b). 

That  (b)  implies  (c)  is  obvious.  To  see  that  (c)  implies  (a),  let  ip  be  an  arbitrary  function 
in  D(Rn  ~  {0})  and  define  u  by  (2.8)  with  o  =  xpp  and  k  =  rn.  Then  u  6  Ck,m,  Au  =  j/>©0 
and  \\u\\2h  =  /  \tp\2dp.  In  addition,  u  €  C°°  and 

Dau{ xo)  =  j 
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Thus  (c)  gives  |  J e-,<l0’^(— i()alb(()dp(()l  <  coj|0||£j(M).  Since  this  holds  for  all  il>  in 
£>(Rn  ~  {0}),  a  dense  subset  of  L2(p),  (a)  must  be  true. 

To  verify  the  last  assertion  suppose  /  €  Ch,m  with  A/  =  g  ©  (v  +  Na)-  By  Proposition 
3.6,  A((—D)ah)  =  pa  ©  (PLm)(0)  -f  Na)-  Using  Proposition  3.4  with  t  =  8y  we  have 
t(0  =  and 

(4.3)  A (8y  *  ( -D)°h )  =  tPa  ©  (PLm)( 0)  +  Na). 

Thus  (/,  8y  *  (—D)ah)h  =  J  gtpadp  +  vTAp^n\0)  =  (— i)mAQ(y).  Here  \a  is  as  above  so, 
as  already  noted,  \a  =  (iD)a f\  this  gives  the  desired  equality.  | 

Our  error  estimates  will  be  based  on  the  following. 

Theorem  4.2.  Let  m,  h,  p  and  a7  be  as  in  Theorem  2.1.  Assume  that  p  satisfies  (4.1) 
with  i  >  max{l,m}.  For  a  point  x0  in  Rn  suppose  that  o  is  a  real  valued,  compactly 
supported  Radon  measure  on  Rn  such  that 

(4.4)  p(x0)  =  J  p(x)do(x) 
for  all  p  in  Pe-i-  Then  for  all  f  in  Ch,m 

(4.5)  | /(•£<))  J  f(x)d<r(x)  <c||/.|U  J  |x-x0|*dM(x) 

where  c  =  {s  +  /  |£|2,/(^)2  dp(^)}1^2  with  s  =  5Z  |Aa,^|  for  i  =  m  and  s  =  0  for 

|or|  =  m  \/3\=m 

t  >  m. 

PROOF:  Let  v  =  6Xo  —  cr  .  By  (4.4),  J p(x)dv(x)  =  0  for  all  p  e  Pt~\ ■  Since  i  >  m, 
Proposition  3.5  applies  to  v  and  from  (3.12), 

(4-6)  |  J  J(T)du(x)\  <  ||n  ©  (w  +  A^OIIhII/IU- 

Here  wp  =  J(ii)^di/(i),  |/3]  =  m.  If  £  >  m  then  w  =  0;  if  i  =  m  then 

wp  =  im  J (x  -  x0)/}di/(x)  =  0  -  im  J (x  -  x0 )3d<j(x). 

Defining  R{9)  by  ei9  =  Ylil'o  (i0)k/k\  +  R{6)  we  have  \R(6)\  <  |0|«/fl  and 

e“<<,# ’°n(0  =  J e,<*-IO'«>dI/(x)  =  j  R((x  -  x0,£))du(x)  =  -  J  R((x  -  x„,0)<M*)- 

If  b  =  /  ]x  -  x0|*d|<7|(x),  then  |n(£)j  <  b^/P.  and,  for  i  =  m,  \w$\  <  b.  From  this  we 
obtain  jjn  ©  (w  +  h//i)||H  <  cb  and  (4.5)  follows.  | 


To  obtain  the  error  estimates  mentioned  at  the  beginning  of  this  section  we  apply  The¬ 
orem  4.2  to  f  =  g  —  gx .  Because  of  the  minimum  norm  property  of  gx ,  ||/j|/,  <  ||g||/,. 
Since  other  fixed  bounds  on  |j/||fc  result  in  acceptable  error  estimates,  the  minimum  norm 
requirement  on  gx  could  be  relaxed  to  simply  a  requirement  that  ||y*  ||a  not  exceed  some 
set  bound.  If  we  choose  a  so  that  supp  a  C  X  then  J  g  —  gxdcr  =  0  and  (4.5)  gives 

(4.7)  |p(x0)  -  ffX(*o)|  <  c||/||*  J  |x-x0|*<f|<r|(x). 

To  make  such  a  choice  of  cr  possible,  it  may  be  necessary  to  restrict  xq.  From  (4.4)  we  see 
that  if  p  =  0  on  supp  a  then  p(x<j)  =  0.  Let 

Nt-i(X)  =  {p  €  Pi- 1  :  p(x )  =  0  for  all  x  E  X}, 

{*)<_!  =  {x  E  R"  :  p(x)  =  0  for  all  p  €  iV/_1(A')}. 

Proposition  4.3.  Let  Et-\(x q,X)  be  the  set  of  all  real  valued,  compactly  supported 
Radon  measures  on  Rn  that  satisfy  both  (4.4)  and  supper  C  X.  Then  E(-1(x0,  X)  is 
nonempty  iff  xq  E  (X)i-i. 

PROOF:  Necessity  of  xo  E  (X)t-i  is  evident  from  the  preceding  discussion.  To  see  that 
this  is  also  sufficient,  consider  the  linear  functionals  on  P(-\  defined  by  Lz(p)  =  p(x). 
Choose  a  (finite)  subset  Y  of  X  such  that  {Ly  :  y  6  K)  is  linearly  independent  and 
Lz  €  span{L„  :  y  €  Y)  for  all  x  in  X.  Then  Ni-^Y)  =  Nt-^X)  and  (Y)i-i  = 

Also,  {Ly  :  y  €  F}  is  a  basis  for  (Pt-i/Ni-i{Y))'-,  let  {py  +  Ne-^iY)  :  y  £  Y)  be  the 
dual  basis.  If  the  polynomials  py  are  replaced  by  their  real  parts  the  result  is  still  dual  to 
{Ly  :  y  G  Y}.  We  may  therefore  assume  that  each  py  is  real  valued.  For  xo  in  (F)<_!, 
LZo  gives  a  linear  functional  on  Pi-\/Nt-i(Y).  Thus  LZo  =  £  cyLy  with  cy  =  LZo{py) 

»6  Y 

and  it  follows  that  a  =  ^  cy6y  is  in  ^_i(x0,.Y).  | 

y€Y 

Of  course  (4.7)  will  give  a  better  error  estimate  if  ct  is  chosen  from  i(io,X)  so  as 
to  minimize  /  jx  —  xo|*d|<r|(x);  we  made  no  attempt  to  do  this  with  our  choice  of  a  in  the 
preceding  proof. 

We  turn  now  to  an  analysis  of  the  rate  at  which  the  error  estimate  goes  to  zero  as 
the  coverage  by  X  improves.  For  this  we  fix  a  region  Q  and  a  function  g  E  Ch,m  and, 
for  various  X,  look  at  bounds  on  | g  -  <7'v|n  given  by  (4.7).  Here  we  use  the  notation 
|/|n  =  supien  |/(x)|. 

The  number  d  =  d(Sl,X)  defined  by 

(4.8)  d(Sl,X)  =  sup  inf  |y  —  x| 

ven*€X 


is  a  standard  measurement  of  how  closely  X  covers  Q.  Using  (4.7)  and  some  mild  assump¬ 
tions  about  fl,  we  will  show  that 

(4-9)  |flf  -  gx\n  =  0{d‘). 
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In  order  to  use  (4.7)  we  assume  (4.1).  In  that  case  Proposition  4.1  assures  us  of  a  uniform 
bound,  for  the  £-th  order  derivatives  of  g  —  gx .  From  this  and  (4.9)  we  can  deduce  that 
the  derivatives  Da(g  —  gx )  of  intermediate  order  0  <  |a|  <  i  satisfy  0(d*~lal)  estimates. 

To  establish  (4.9)  we  proceed  along  lines  used  by  Duchon  [6].  We  start  by  assuming  that 
there  are  positive  constants  M,  £o  such  that  for  every  0  <  e  <  £o, 

(4.10)  QC  (J{5(t,£M)  :  t€T£} 

where  Ts  =  {t  £  Rn  :  B(t,£ )  C  ft},  B(t,r )  =  {x  £  Rn  :  \x  —  t\  <  r}.  Arguments  in 
Section  1  of  [6]  show  that  such  constants  M,  £o  will  exist  if  ft  satisfies  a  cone  condition. 

Next  we  select  a  Pt-i -unisolvent  set  of  points  a  (a)  £  Rn,  |a|  <  t.  A  corresponding 
set  of  Lagrange  polynominals,  p“  6  Pt-i,  |t|  <  Z,  is  determined  by  the  requirements: 
p7(a(a))  =  1,  for  a  =  7;  p7(a(a))  =  0,  for  0^7.  The  matrix  Aaj  =  (a(a))^,  |a|  < 

|/?|  ^  is  nonsingular.  If  p7(x)  =  (A-*1)/}  -tx<3  then  p7(a(a))  =  (AA-1)a  7  so  p7  =  p“. 

\ii\<e 

The  function  a  — >  a(a)  can  be  identified  with  a  point  in  B  =  B(a(a),6).  Clearly, 

M<* 

b  6  B  iff  |b(a)  —  a(a)|  <  6  for  all  |a|  <  L  Now  choose  6  >  0  so  that  Ba j  =  (b(a))/J  is 
invertible  for  ail  b  £  B.  As  justified  by  replacing  the  points  a(a)  with  the  points  6-1a(a), 
we  assume  <5  =  1. 

Choose  R  so  that  13(0,  R)  contains  all  the  unit  balls  2?(a(a),  1),  |a|  <  L  The  Lagrange 
polynomials  p„  depend  continuously  on  b.  Let 

A(r)  =  sup{  Yj  iPa(*)l  :  1*1  <  r-  b  £  b}. 

M<« 

For  d  =  d(Q,X)  <  £q/R ,  set  £  =  Rd  and  fix  a  point  t  in  Te.  The  balls  B{t  +  da(a),d) 
are  contained  in  B(t,Rd)  =  B(t,£ )  C  ft-  By  (4.8),  for  every  |a|  <  i ,  there  is  at  least  one 
point  xQ  in  X  D  B(t  +  da(a),d).  If  b  is  the  point  in  B  defined  by  xa  =  t  +  db(a),  and 


with  x0  arbitrary,  then  supp  a  C  XC\B{t,  e)  and  (4.4)  holds  for  all  p  £  P(-i ;  to  verify  (4.4), 
take  q  so  that  p(x)  =  y((x  -  t)/d)  and  use  £  Pa(y)q(b(<*))  =  ?(y)  with  y  =  (x 0  -  t)/d. 

\°\<i 

Suppose  i0  €  B(t,£M  +  d).  Then  |x0  -  t\/d  <  (RM  +  1)  so  / d|oj  <  A (RM  +  1).  Also, 
for  x  £  supp  <r, 

|x  ~  X0|  <  |x  -  t|  +  |t  -  x0|  <  (R  +  RM  4-  l)d. 

Thus  f  |x  -  xo|*  d\a\  <  C°dt  with  C°  =  (R  +  RM  +  l)*A(i?A/  +  1).  Since  io  is  any  point 
in  B(t,£M  +  d),  (4.7)  gives  |y  -  gx\Bu,t\i+d)  <  c||/||*C°  dl.  By  (4.10),  if  y  £  ft  we  can 
choose  t  £  T,  so  that  y  £  B(t,£M).  Then  B(y,d)  C  B(t,£M  +  d)  so  for  every  y  €  ft, 

H-ll)  \g-gx\BM<cC9\\f\\hd'. 
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This  is  more  than  required  for  (4.9),  but  will  be  useful  for  derivative  estimates. 

By  Proposition  4.1,  /  =  g  —  gx  is  in  C*(R”).  For  y  £  ft,  8  £  R  and  u  £  Rn  with 
M  =  i,  let  cp(0)  =  f(y  +  0u).  Then 

(4.12)  <pW(0)  =  kl  V  ^rD°f(y  +  6u). 

a! 

M=* 

By  (b)  in  Proposition  (4.1),  |<p^|r  <  C'\\f\\h  with  C'  =  t\  J2  ca/a -  From  (4.11)  we  also 

have  a  botind  on  \y>\ /  where  I  is  the  interval  [— d,d\.  For  0  <  k  <  £,  the  results  of  Gomy 
[8]  summarized  in  [12]  then  give 

(4-13)  |v>(fc)(0)|  <  Ct||/||Adf-fc 

where  C*  =  16(2e)A(cC0)1“fc^  [max(C',f!2_/cC°)]fc^.  Note  that  C*  can  be  calculated 
from  n,  £,  m,  h  and  M ;  the  choice  of  R  depends  only  on  £  and  n  so  C°  requires  only  £,  n,  M 
while  c  and  C'  require  only  m,h,£,  n.  Combining  (4.12)  and  (4.13)  gives 

(4-14)  sup  I  £  ^D°f(y) I  <  ||/|U  dl~k 

a!  1  kl 


for  every  y  £  fi.  Since 


is  a  norm  for  Vi,  we  conclude  that  [Da/|n  =  O  ( de  for  every  |a|  <  t.  To  summarize 
we  state 


Theorem  4.4.  Let  m,h,p  and  a,  be  as  in  Theorem  2.1.  Assume  (4.1)  holds  with  t  > 
max{l,m}  and  suppose  Q  is  a  subset  of  R"  that  satisfies  (4.10)  for  some  M,e0  >0.  Then 
there  are  positive  constants  C ,  do  such  that  if  f  £  Ch,m  vanishes  on  a  set  X  and  the  number 
d  =  d(Cl,X)  defined  by  (4.8)  is  less  than  do  then  for  all  [or |  <  £, 


(4.15) 


\D°f\n<C\\f\\hd'-W. 


5.  Examples.  In  this  section  we  look  at  some  examples  of  conditionally  positive  definite 
functions  h.  For  these  examples  we  determine  the  measure  p  and  coefficients  a7, 17I  =  2m 
that  appear  in  (2.4).  As  cam  be  seen  from  (5.2)  below,  these  examples  all  satisfy  (4.1)  and 
do  so  for  arbitrarily  large  choices  of  £.  Thus  the  error  estimates  in  Section  4  apply,  showing 
that  for  interpolation  based  on  amy  of  the  h's  given  here,  approximation  of  arbitrarily  high 
order  can  be  achieved. 

For  a  £  R,  let  wa  be  the  function  on  Rn  defined  by 


(5-1) 


w«(0  = 


2  y(w_.)/2(KD 

(2x)"/2  2°/2  |£|("-°)/2 
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W*>  - r  (I)  + =  (|+*)r(l)  (fc-<§  +  *>s)  *■ 

Estimates  from  thi  an  be  used  to  justify  an  application  of  Lebesgue’s  dominated  conver¬ 
gence  theorem  that  shows 

J  h.2k(x)p(x)dx  =  ^  Urn  ^  J  [/»«(*)  “  r  (|)  l1  +  |x|2)k  <p(x)dx. 

Now  p  €  Z>(Rn  ~  {0})  so  /(I  +  |x| 2)kp(x)dx  =  0.  We  therefore  have  J  /i_2*(x)<^(x)dx  = 
lima__2i  / 'f(Owa(()d(  which  gives  (5.5)  for  a  =  -2k.  | 
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Theorem  5.2.  If  m  is  a  nonnegative  integer  and  a+2m  >  0  then  (2.4)  holds  with  h  =  ha, 
dp(£)  =  wa(£)d£,  and  a7  =  0  /or  |-y|  =  2m. 

PROOF:  If  m  =  0  then  a  >  0.  As  already  mentioned,  (5.5)  holds  for  all  p  in  <S  if  a  >  0; 
thus  we  have  (2.4)  with  m  =  0  and  a  >  0.  For  the  rest  of  the  proof  we  assume  m  >  1.  Let 


#.(*)  =  J  [^l<,'{>  -  «<)  5] (-  ».«)<• 


By  Proposition  2.2  we  have:  ua  £  C(Rn),  ua(x)  =  o(|x|2m),  and  for  all  <p  in  S 

J  ua(x)<p(x)dx  =  (Sa,p) 

where  ( Sa,il> )  =  /  [0  —  xT2m_1^](/)u;a(/)d/.  Let  Ta  be  the  tempered  distribution  defined 
by  J  ha(x)p(x)dx  =  (Ta,p).  By  (5.5),  (Ta,iJ>)  =  (Sa,ip)  for  all  ?/>  £  Z>(Rn  ~  {0}).  Thus 
(Ta  —  Sa)''  =  ha  —  ua  is  a  polynomial  q.  Both  ha  and  ua  are  o(|x|2m)  at  |x|  =  oo,  so 
deg  q  <  2m.  The  desired  instance  of  (2.4)  now  follows  from  ( ha  —  q,p)  =  ( Sa,p ).  | 

6.  Equivalence  of  definitions.  Theorem  6.1  below,  when  combined  with  Proposition 
2.4  shows  the  equivalence  of  the  definition  of  conditional  positive  definiteness  adopted  here 
with  that  used  in  [11].  As  in  [11]  we  define  Pm-i  to  be  the  space  of  all  finite  measures 
v  on  R"  that  have  support  consisting  of  a  finite  set  of  points  and  satisfy  v(p)  —  0  for  all 
p  £  Pm-\.  The  space  obtained  by  relaxing  the  support  requirement  to  allow  compact  sets, 
rather  than  only  finite  sets,  will  be  denoted  by  If  v  —  Ct^x,  then 


_  N  N 

■=i 

and  v  £  Pm- i  Iff  Sfli  c»If  =  0  f°r  ®II  lQl  <  m-  If  dt/(x)  =  p{x)dx  then 

v  [v  *  h j  =  Jj  p(x)p(y)h(x  —  y)dxdy 
and  u  is  in  (P^-i)  if  V  €  Vm. 

Theorem  6.1.  Let  h  be  an  arbitrary  function  in  C(Rn).  If  v  (v  *  h^j  >0  holds  for  all 
v  £  Pm— i  then  it  holds  for  all  u  €  (Pm- 1)- 

PROOF:  Fix  v  in  (P^-i)  and  let  K  be  its  support.  Recall  that  the  finite  Borel  measures 
on  If  form  the  dual  C(K)1  of  C(K),  the  continuous  functions  on  I\  with  the  sup  norm 
topology.  The  norms  involved  in  this  duality  will  be  written  as  follows:  for  /  £  C(K), 
\f\l<  =  supieK  |/(x)|;  for  a  £  C(If)1,  ||<r||  =  / d|cr|.  Let  hy(x)  =  h(y  -  x).  I\  is  compact, 
so  for  every  e  >  0  there  is  a  finite  set  Fc  C  If  such  that  if  y  £  If  then  |hy  —  /iyo|/v-  <  e  for 
at  least  one  yo  £  Ft.  If  a  is  in  the  weak*  neighborhood 

U{v,Fg,e)  =  {<r£  C(If)'  :  |(<r  -  u)  (hyo)|  <  5  for  all  y0  £  Fe) 
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and  y  6  K  then,  for  a  suitable  choice  of  yo  e  Ft, 

\(<r  -  v)  (hy)|  =  |(<r  -  v)  ( hy  -  hyo)  (hy0)|  <  (|k  -  HI  +  l)e. 

Since  (<7—1 ')*h(y)  =  (<r— v)  ( hy ),  we  get  |(<7  —  v)*h\x  <  (||<r— i/||  +  l)e  for  all  a  G  U(v,  Fe,s). 
For  such  a  let  w  be  the  number  defined  by 

w  =  a  (cr  —  v  (u  *h^  =  a  ({a  —  u)  *  Jij  +  {a  —  v)  (v  *  h'j 

and  observe  |ie|  <  ||cr || J(cr  -  v)  *  S|/c  +  | (cr  -  u)  (v  *  h^j  |. 

Let  B  =  {a  G  C(K)1  :  H  <  ||i/||}  and  take  C  =  B  n  ( P =  B  n  P^_x.  By 
arguments  given  below,  5  is  weak*  dense  in  C.  This  allows  us  to  choose 

a  €  Sfl  {<7  G  U{v,  Fe,e) :  |(cr  -  u)  (v  *  h)  |  <  e}. 

For  that  choice  we  have  a  (cr  *  h^j  >0  and 


M  <  IMI  (Ik  ~  HI  +  Ik  +  £  <  IMI  (2|kll  +  l)e  +  e. 

Since  w  is  arbitrarily  small,  we  see  that  i/  (i /  *hj  must  be  arbitrarily  close  to  points  on 
the  positive  real  axis  and  hence  must  be  greater  than  or  equal  to  zero. 

C  is  convex  and  weak*  compact  so,  by  the  Krein-Milman  theorem,  C  is  the  closed  convex 
hull  of  its  extreme  points.  Since  5  is  convex  it  will  be  weak*  dense  if  it  contains  all  of  the 
extreme  points  of  C.  Suppose  cr0  is  411  extreme  point  of  C  that  is  not  in  S.  Then  supp  a0 
cannot  be  a  finite  set  so  we  can  subdivide  it  into  J  =  2(1  +  dimPm_i)  disjoint  subsets 
with  \<Ta\{Ej)  ^  0.  Let  <Jj{E)  =  a 0(Ej  fl  E)  and  take  c0,;  =  f  xQdaj(x).  By  a 
dimension  argument,  there  is  a  point  a  G  R/  ~  {0}  that  satisfies  the  equations: 

J  J 

X]  °>IM  =  °;  X]  aic°’i  =  °»  M  <  m- 

;=i  ;=i 

For  t  6  R,  let  cr‘  =  Ylj=i(  1  +  Then  a 1  G  (F^-i)  and  if  (1  +  taj)  >  0, 

j  J 

Ik* II  =  £(i  +  ««;)IM  =  Ell^H  =  M  *  HI- 

;=i  >=i 

Thus  ff'eC  for  all  t  in  an  interval  about  0.  This  contradicts  the  assumption  that  a0  was 
an  extreme  point  of  C  because  a*  =  ctq  only  if  t  =  0,  as  seen  from  the  fact  that  a  ^  0  and 
(kill  /O  for  all  j  =  | 
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Polyharmonic  Cardinal  Splines: 
A  Minimization  Property 

W.  R.  Madych*  S.  A.  Nelson* 


Abstract 

Polyharmonic  cardinal  splines  are  distributions  which  are  annihilated 
by  iterates  of  the  Lapladan  in  the  complement  of  a  lattice  in  Euclidean 
n-space  and  satisfy  certain  continuity  conditions.  Some  of  the  basic  prop¬ 
erties  were  recorded  in  our  earlier  paper  on  the  subject.  Here  we  show 
that  such  splines  solve  a  variational  problem  analogous  to  the  univariate 
case  considered  by  I.  J.  Schoenberg. 


1  Introduction 


Recall  that  a  fc-harmonic  cardinal  spline  is  a  tempered  distribution  tx  on  R" 
which  satisfies 

.  .  (i)  u  is  in  CJ*_0_1(.Rn)  and 

(it)  A*u  =  0on  Rn\Zn. 

Here  A  is  the  usual  Laplace  operator  defined  by 


>=i 


d\ 

fhj 


and,  if  k  is  greater  than  one,  A*  denotes  its  k- th  iterate,  Aku  =  A(At-1u). 
Of  course  A1  =  A  and  Zn  denotes  the  lattice  of  points  in  Rn  all  of  whose 
coordinates  are  integers. 

Such  distributions  were  considered  in  [1)  where  their  basic  properties  were 
recorded  and  our  motivation  for  studying  them  was  indicated.  One  of  the  key 
developments  there  was  the  existence  and  uniqueness  of  the  solution  to  the  so- 
called  cardinal  interpolation  problem  for  fc-harmonic  splines.  This  result  may 
be  summarized  as  follows:  Given  a  sequence  {aj},  j  in  Zn,  of  polynomial  growth 
and  an  integer  k  satisfying  2k  >  n  +  1  there  is  a  unique  fc-harmonic  spline  / 
such  that  /(j)  =  aj  for  all  j  in  Zn. 

In  this  paper  we  continue  recording  properties  of  these  distributions.  Specif¬ 
ically  we  show  that  under  appropriate  conditions  the  fc-harmonic  splines  are 
solutions  of  a  variational  problem.  These  properties  together  with  those  con¬ 
sidered  in  [1]  are  remarkably  similar  to  well  known  properties  of  the  univariate 
cardinal  splines  of  I.  J.  Schoenberg,  see  [2].  For  example,  much  of  the  mate¬ 
rial  in  this  paper  parallels  matter  found  in  [2,  Chapter  6].  On  the  other  hand, 
because  of  the  non-existence  of  B-splines  with  compact  support  in  the  general 

'Department  of  Mathematics,  University  of  Connecticut,  Starrs,  CT  06268.  Both  authors 
were  partially  supported  by  a  grant  from  the  Air  Force  Office  of  Scientific  Research,  AFOSR- 
86-0145 

t  Department  of  Mathematics,  Iowa  State  University,  Ames,  LA  50011. 
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multivariate  case,  our  development  is  significantly  different  from  that  found 
there. 

The  variational  problem  alluded  to  above  is  considered  in  the  context  of 
the  space  L\(Rn),  the  class  of  those  tempered  distributions  whose  derivatives 
of  order  k  are  square  integrable.  The  properties  of  this  class  and  its  discrete 
analogue  which  are  needed  for  our  development  are  presented  in  Section  2.  In 
Section  3  it  is  shown  that  the  class  of  ib-harmonic  splines  in  L\(Rn)  is  a  closed 
subspace  of  L\(Rn)  whose  corresponding  orthogonal  projection  operator  is  quite 
natural;  this  is  the  key  to  what  may  be  called  the  minimization  property  of  these 
splines.  Necessary  and  sufficient  conditions  on  a  sequence  {vj},  j  in  Zn,  which 
allow  it  to  be  interpolated  by  the  elements  of  Ll(Rn)  are  given  in  Section  3; 
furthermore,  it  is  shown  that  the  unique  element  of  minimal  L\{Rn)  norm  which 
interpolates  such  a  sequence  is  the  fc-harmonic  spline  interpolant. 

The  conventions  and  notation  used  here  are  identical  to  that  in  [1],  In 
particular,  SHt{Rn)  denotes  the  space  of  ib-harmonic  splines  on  Rn\  k  is  always 
assumed  to  be  an  integer  such  that  2k  >  n  4-  1.  The  distributions  Lt  and 
are  defined  by  the  formulas  for  their  Fourier  transforms, 


(2) 


Lt(0  =  (2*)-"/’ 


K|-“ 

£j€*.  K-2*j|-2* 


and 

(3)  *»K)  =  Kl  2kU0- 

Their  properties  which  are  relevant  to  our  development  are  listed  in  [1],  Here 
we  merely  recall  that  Lt  is  called  the  fundamental  function  of  interpolation; 
it  is  the  unique  fc-harmonic  spline  such  that  L*(j)  =  60j,  j  in  Zn,  where  $0j 
is  the  Kronecker  delta.  In  particular,  every  ib-harmonic  spline  u  enjoys  the 
representation 

(4)  «(*)=  E  «(j)M*-j) 

jeZ" 

where  the  series  converges  absolutely  and  uniformly  on  compact  subsets  of  Rn. 
For  more  details,  background,  and  references  see  [1], 


2  Definition  and  properties  of  L2k(Rn)  and  i\{Zn) 

The  linear  space  Ll(Rn)  is  defined  as  the  class  of  those  tempered  distributions 
u  on  /T*  all  of  whose  fc-th  order  derivatives  Me  square  integrable;  in  other  words 

L\(Rn)  =  {u  €  S'{Rn)  \  Dv u  is  in  L\Rn)  for  all  v  with  |i/|  =  ifc}. 

For  this  space  a  semi-inner  product  is  given  by 

(5)  c*  f  D‘,u(x)D‘,v(x)dx 

M-*  Jr’ 

where  the  positive  constants  c„  are  specified  by 

(6)  Ifl”  =  E 

M=t 

The  semi-norm  corresponding  to  (5)  is  denoted  ||u||2,t,  thus  IMI2,*  =  («.«)*• 
The  null  space  of  this  semi-norm  is  the  class  of  polynomials  of  degree 

less  than  or  equal  to  fc  —  1. 
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Note  that  there  are  many  semi-norms  equivalent  to  ||u||2,k  on  Ll(Rn).  The 
reason  for  the  particular  choice  used  here  is  the  fact  that  for  u  in  S(Rn),  by 
virtue  of  Plancherel’s  formula, 

Nil.*  =  /  KI2*l*(OI2<ff. 

Jr * 

In  view  of  (3)  and  (4),  it  is  not  difficult  to  conjecture  that  it  is  the  minimization 
of  this  particular  semi-norm  subject  to  the  appropriate  interpolator  conditions 
which  leads  to  a  solution  which  is  a  fc-harmonic  spline. 

The  objective  of  this  section  is  to  develop  properties  of  Ll(Rn)  and  its  dis¬ 
crete  analogue  which  will  be  needed  in  our  treatment  of  the  variational  problem 
in  the  following  sections. 

Since  the  norm  on  L\(Rn)  only  allows  us  to  distinguish  between  the  equiva¬ 
lence  classes  determined  by  it,  dealing  with  the  individual  elements  of  Ll(Rn)  is 
rather  slippery  business.  Nevertheless  we  regard  the  space  L\(Rn)  as  a  subspace 
of  tempered  distribution  and  not  as  a  collection  of  equivalence  classes.  Thus  if 
a  distribution  u  is  representable  by  a  continuous  function  /,  namely 

=  {f<4>)  -  /  f(x)<f>(x)dx 
Jr • 

for  all  <t>  in  S(Rn),  then,  following  standard  convention,  we  simply  identify  u 
with  /  and  say  that  u  is  continuous.  The  following  propositions  allow  us  to  get 
a  somewhat  better  grip  on  the  distributions  in  L\(Rn). 

The  first  proposition  follows  from  a  routine  argument  and  may  be  regarded 
as  folklore. 

Proposition  1  S(Rn)  is  dense  in  L\(Rn). 

The  notion  of  unisolvent  set  is  needed  in  the  statement  of  the  next  proposi¬ 
tion.  Recall  that  a  unisolvent  set  Q  for  irk_i (#")  is  a  finite  subset  of  Rn  con¬ 
sisting  of  k(n)  elements  with  the  property  that  if  p  is  in  ir*_i(Rn)and  p(x)  =  0 
for  all  *  in  Q  then  p(x)  =  0  for  all  x  in  Rn.  Here  t*_i (Rn)  denotes  the  class 
of  polynomials  on  Rn  of  degree  no  greater  than  k  —  1  and  fc(n)  denotes  its 
dimension. 

Proposition  2  Assume  2k  >  n  4-  1.  Then  the  elements  of  Ll(Rn)  are  con¬ 
tinuous  functions  and  there  is  a  linear  map  P  on  Ll(Rn)  with  the  following 
properties: 

(i)  Pu  is  in  rk_1(Rn). 

(ix)  P2u  =  Pu. 

(iii)  If  Q  is  a  unisolvent  set  for  jrk_i(Rn)  then 

(7)  |/M*)I  <  C(1  +  |x|*-1K!l«||2,fc  +  Mn) 

where  |ju||n  denotes  the  maximum  of  u  on  Cl  and  C  is  a  constant  which  depends 
on  Cl  but  is  independent  of  u. 

(iv)  IfQuszu-Pu  then  Qu  is  continuous  and  satisfies 

(8)  IIQuk*  =  IH2,* 
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and 

(9)  l<?«(*)l  <  C(1  +  |*|*)||u||2,* 

when  C  is  a  constant  independent  of  u. 

Proof  The  operator  P  is  defined  by  the  formula  for  the  Fourier  transform 
of  Pu.  Namely,  if  tf>  is  any  element  of  S(Rn)  then 

(1°)  {Pu,<t>)  =  (u,P*x) 

where  p*  is  the  Taylor  polynomial  of  <f>  of  degree  k  —  1  and  centered  at  0,  x  is 

a  fixed  function  in  Cg°(Rn )  which  is  equal  to  one  in  a  neighborhood  of  0  and 

supported  in  the  unit  ball  centered  at  0.  Of  course  p$x  denotes  the  pointwise 
multiplication  of  p^  and  x-  (Note  that  the  definition  of  P  depends  on  the  choice 
of  X-)  Pu  is  well  defined  by  formula  (10).  It  is  easy  to  check  that  P  is  linear 
and  satisfies  statements  (i)  and  (it)  of  the  proposition.  Next  we  verify  (tv). 
Write 

(11)  Qu  =  u  —  Pu  =  «!  +  U2 

where  tki  =  xQu,  uj  =  Qu  —  U\,  and  x  is  the  function  in  the  definition  of  P 
above.  More  specifically,  for  any  <j>  in  S(Rn) 

(12)  (itu<1>)  =  (*,(</>- P*)x) 

and 

(13)  (ui,<t>)  =  («.(1  ~  x)4>)- 

Since  has  compact  support,  Ui  is  analytic  and 

(14)  uj(a!)  =  (2*)-n/J(6i,e,) 

where  «*(()  denotes  the  exponential  Using  (12)  write 

(15)  <«!,«,)  =  («,?**} 

where 

(16)  ?»(0x(0  =  WO  -  PeMMO  =  (*,  0**.(0x(0 

and  tl>x  is  analytic  and  bounded  independent  of  x.  Since 

<*.o*  =  £ w 

w\=k 

formulas  (15)  and  (18)  result  in 

(17)  («i,e,)  =  6v**'(u, ni>xX) 

I  *-1=* 

where  u„  =  (>'u(0-  Recalling  the  fact  that  if  |i/|  =  k  then  u„  is  in  L2(Rn)  with 
norm  dominated  by  ||u||j,*  we  see  that  (17)  implies  that 

(18)  |<*i.e.)|<q«|‘||».||M 
which  together  with  (14)  shows  that 

(19)  M*)l  <  <7|*l*IMk*- 
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From  (13)  62  =  (1  —  x)u  and  thus  “2  »  in  L1(iZ'*)  since 

J  (i "  x(0)l*(0«  <  C  y  (1  - 

This  implies  that  112  is  continuous  and 

(20)  M*)|  <  q|«||2,t. 

Now,  ui  and  U2  ere  both  continuous  and  hence  it  follows  that  Qu  is  also.  Identity 
(11)  together  with  inequalities  (19)  and  (20)  imply  (9).  Since  (8)  is  an  immediate 
consequence  of  the  fact  that  u  —  Qu  is  in  ** -i(Rn)  the  proof  of  statement  (iv) 
is  complete. 

Finally,  to  see  (in )  let  ft  be  the  collection  of  points  {*  . . x^)  where  N  = 

k(n)  is  the  dimension  of  i(R")  and  let  pj,  j  =  1, . . . ,  N  be  the  polynomials 
in  Ti_i (Rn)  which  are  uniquely  defined  by  Pj(xm)  =  6jm  where  Sjm  is  the 
Kronecker  delta.  Since  Pu  =  u  —  Qu  is  in  **_i(P")  and  ft  is  unisolvent  for 
jr*_i(Pn)  we  see  that 

N 

(21)  Pu(x)  =  £{«(*;)  -  Qu(xj))pj(x). 

i=i 


Now 

(22)  !«(*>)  -  Q«(*,  )l  <  K*i)|  +  C(l  +  M*)||u||,,* 
and 

(23)  ip,(*)i<q(i+i*i*-‘). 

Formula  (21)  together  with  inequalities  (22)  and  (23)  imply  the  desired  result. 


The  operators  P  and  Q  are  complementary  orthogonal  projections  on  L\(Rn). 
That  is,  every  u  in  L\(Rn)  can  be  expressed  as 

(24)  u  =  Pu  +  Qu. 

It  is  clear  from  the  proof  that  the  operator  P  is  not  unique. 

We  now  turn  our  attention  to  a  discrete  analogue  of  L\{Rn)  which  we  refer 
to  as  fJ(Zn).  This  class  of  sequences  may  be  described  as  follows. 

First,  recall  that  ya,  a  real,  is  the  class  of  those  sequences  u  =  {uj},  j  in 
Zn ,  for  which  the  norm 

<25)  N"w==i?.(iTiiiF 


is  finite.  Let 

(26)  y00  =  (J  y°  and  y-°°  =  Q  ya 

a  a 

where  the  intersection  and  union  are  taken  over  all  or,  —00  <  a  <  00.  Also, 
we  say  that  the  sequence  u  =  {uj}  is  in  (Zn)  if  it  is  the  restriction  of  an 
element  p  in  x*_i (Rn)  to  Zn\  namely,  uj  =  p( j)  for  all  j  in  Zn  where  p  is  in 
**-i(ZB). 
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Given  a  sequence  u  in  y°°,  for  each  »,  t  =  1, . . . ,  n,  T,u  is  the  sequence 
(Ti“)j  =  uj+e,  -  uj 

where  e,-  is  the  n-tuple  with  1  in  the  i-th  slot  and  0  elsewhere.  In  other  words, 
T{  is  a  difference  operator  in  the  direction  e,.  For  any  multi-index  it  Tv  is  the 
usual  composition  (product)  of  T\, . . . ,  T„,  namely  Tf 1  •  ■ 

The  space  0k(Zn)  consists  of  those  elements  u  =  {uj}  in  y00  for  which 

<27)  Mh  =  £  £  i(^«)ji2 

jez-  M=* 

is  finite.  The  corresponding  semi-inner  product  is  given  by 

|k|=*  jjZ* 

The  notation  used  to  denote  discrete  sequences  and  certain  discrete  sequence 
norms  is  identical  to  that  used  for  the  ‘analog’  case  considered  earlier  in  this 
section.  This  should  cause  no  confusion;  the  meaning  should  be  clear  from  the 
context. 

Proposition  3  y-°°  is  dense  in  t2(Zn). 

Proposition  4  There  is  a  linear  map  P  on  fjj (Zn)  with  the  following  proper¬ 
ties: 

(i)  Pu  is  in  ri_l(Zn). 

(ii)  P2 u  =  Pu. 

(Hi)  If  ii  is  a  unisolvent  set  for  *k-i(Zn)  then 

(29)  |Puj|<C(l  +  |j|*-‘)(|H|a.t  +  |H|n) 

where  ||u||n  denotes  the  maximum  ofu  on  ft  and  C  is  a  constant  which  depends 
on  ft  inf  is  independent  of  u. 

(iv)  If  Qu  =  u  —  Pu 

(3°)  ||Qu||Ji4  =  IHk* 

and 

(31)  |Q«j|<C(l  +  lj|*)|H|a>* 

where  C  is  a  constant  independent  ofu. 

The  proof  of  these  propositions  essentially  consists  of  identifying  the  space 
fJ(Zn)  with  an  appropriate  class  of  tempered  distributions  and  applying  the 
arguments  used  in  proving  the  analogous  facts  for  £j(fZ")  in  Propositions  1  and 
2  mutatis  mutandis.  Indeed,  observe  that  y~°°  equipped  with  the  seminorms 
defined  by  (25)  is  a  topological  vector  space  whose  dual  can  be  identified  with 
y°° .  Now,  the  Fourier  transform  can  be  defined  on  y~°°  in  the  natural  way; 
namely 

u(0  =  (2 x)-"'1  £  u(j)e-‘<i'<>. 

jez* 
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It  maps  y~°°  into  the  class  of  infinitely  differentiable  periodic  functions  on  fi". 
Hence  the  Fourier  transform  may  be  defined  on  i'00  via  duality  in  the  usual 
manner;  it  maps  y°°  onto  the  class  of  periodic  tempered  distributions.  With 
these  identifications,  it  should  be  clear  how  to  modify  the  arguments  used  in 
the  proof  of  Propositions  1  and  2  so  that  they  apply  to 

Another  very  useful  identification  may  be  described  as  follows. 

Let  M(Zn)  be  the  class  of  those  tempered  distributions  /  which  enjoy  the 
representation 

(32)  /(*)=  £ 

where  6(x)  denotes  the  unit  Dirac  distribution  at  the  origin.  Note  that  M(Zn) 
is  a  closed  subspace  of  S'(Rn).  Also  recall  that  the  Fourier  transform  is  an 
isomorphism  of  M{Zn )  onto  the  class  of  periodic  distributions. 

Observe  that  y00  and  M(Zn)  are  algebraically  isomorphic  via  the  mapping 

(33)  ti  — ►  ]jT  uj«(*  -  j). 

Thus,  whenever  convenient,  we  may  view  elements  of  y°°  as  being  in  M(Zn) 
and  vice  versa. 

Finite  differences,  such  as  those  used  in  the  definition  of  (/?"),  may  be 
considered  elements  of  M(Zn)  as  follows. 

Let  T  be  the  subset  of  M(Zn)  consisting  of  those  elements  whose  repre¬ 
sentation  (32)  contains  at  most  a  fjnite  number  of  non-zero  coefficients  aj.  The 
Fourier  transform  is  an  isomorphism  of  T  onto  the  space  T  consisting  of  trigono¬ 
metric  polynomials.  Note  that  T  can  be  identified  with  a  class  of  finite  difference 
operators  via  convolution  in  the  natural  way;  namely,  if 

(34)  r(*)  =  2>j«(*-j) 

is  an  element  of  T  and  ti  is  any  tempered  distribution  then 
T*u(a:)  =  ^Oju(*-j) 

is  a  finite  difference  of  /.  Thus  we  will  often  refer  to  elements  of  F  as  finite 
differences. 

In  view  of  the  identification  (33),  we  may  view  T  as  the  class  of  finite  dif¬ 
ference  operators  on  y°°  or  S'(R^).  In  particular,  the  operators  V  used  in  the 
definition  of  t\(Zn)  may  be  regarded  as  elements  of  T  whose  Fourier  transforms 
are  the  trigonometric  polynomials 

(35)  V>  =  (e*‘  -  1)*‘  •  •  •  (e,f»  -  1)"*. 

More  generally,  if  T  is  a  finite  difference  operator  of  form  (34),  we  write  Tu 
to  denote  T  *  u  if  ti  is  in  S'(Rn)  and,  if  u  is  in  y°°,  to  denote  the  sequence 
representing  the  natural  action  of  T  on  u,  namely, 

(^u)j  =  ^aiuj_i  • 

i 
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3  Polyharmonic  splines  and  L\(Rn) 

Recall  that  a  continuous  function  /  on  Rn  interpolates  a  sequence  u  =  (uj  }  if 
/(j)  =  uj  for  all  j  in  Zn.  Proposition  2  together  with  existence  and  uniqueness 
for  the  cardinal  interpolation  problem  for  Jb-harmonic  splines,  see  [1],  clearly 
imply  the  following. 

Proposition  5  If  2k  >  n  + 1  and  u  is  in  L\(Rn)  then  u  is  continuous  and  of 
polynomial  growth.  The  sequence  of  values  {u(j)},  j  in  Zn,  is  in  yk  and  there 
is  a  unique  k-harmonic  spline  which  interpolates  this  sequence. 

If  u  is  in  Ll(Rn)  let  S* u  be  the  unique  ^-harmonic  spline  which  interpolates 
the  data  sequence  (u(j)},  j  in  Zn\  that  is  Siu(j)  =  u(j)  for  all  j.  Recall  that  we 
may  write 

(36)  S*u(z)  =  51  ~j) 

jsz* 

where  Lk  is  the  fundamental  spline  defined  in  the  Introduction.  Clearly  the 
mapping  u  — »  S*u  is  linear  and  5* u  =  u  whenever  u  is  in  SHk(Rn).  In  what 
follows  we  will  show  that  this  mapping  is  an  orthogonal  projection  of  Ll(Rn) 
onto  SHk(Rn)OLl(Rn). 

Throughout  the  rest  of  this  section  P  and  Q  will  denote  a  fixed  pair  of 
complementary  projections  whose  existence  is  guaranteed  by  Proposition  2.  We 
begin  with  some  technical  lemmas. 

Lemma  6  Suppose  2k  >  n  +  1  and  {um},  m  =  1 . is  a  sequence  in  Ll(Rn). 

If{um)  converges  to  u  in  L\(Rn)  then 

(i)  {Qum}  converges  to  Qu  uniformly  on  compact  subsets  of  Rn. 

(ii)  {S*Qtim}  converges  to  SkQu  uniformly  on  compact  subsets  of  Rn. 

Proof  Choose  any  positive  numbers  r  and  c  and  observe  that  (i)  will  follow 
if  we  can  show  that 

(37)  |Q«m(*)  -  Qu(x)|  <  f 

whenever  m  is  sufficiently  large  and  for  all  x  such  that  |x|  <  r.  From  (9)  we 
have 

(38)  l<?um(x)  -  Qu(*)|  <  C(1  +  |x|‘)||um  -  «i||2,t. 

Now  from  (38)  it  is  easy  to  see  that  choosing  m  so  that 

||um  -  «||a>  <  <{C(1  +  r*)}-1 


implies  (37). 

To  see  (ii)  observe  that  (36),  (38),  and  the  linearity  of  Sk  imply 
|S*Qum(x)  -  SiQu(x)|  <  C  j  £  (1  +  li|‘)£*(*  -  j)  |  ||um  -  u||2i*. 

Ijsz*  J 

Now,  using  the  exponential  decay  of  Lk,  see  (1),  it  is  clear  that  (ii)  follows  from 
essentially  the  same  reasoning  as  (i).  ■ 
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Lemma  7  If  2k  >  n  + 1  and  u  is  in  S(Rn)  then  Sku  is  in  Ll(Rn)  and  there  is 
a  constant  C,  independent  ofu,  so  that 


(39) 


HSmlk*  <  C||t*ll2,fc 


Proof  Recall  that 

(40)  Sku(Z)  =  U(t)Lk(0 
where 

u(o  =  £*«- 2tj)  =  (2*rn/J  E  «u)«",<j'{>  • 

jez*  jez* 

Observe  that  by  virtue  of  (36),  (40),  and  Plancherel’s  formula  (39)  is  equivalent 

to  r  r 

(41)  /  \tfkmQLk(t)fdt  <  c  /  Ki"|fi(oi2«. 

Jr*  Jr » 

That  S*u  is  in  L\(Rn)  follows  from  the  readily  transparent  fact  that  the  right 
hand  side  of  (41)  is  finite. 

The  remainder  of  this  proof  is  devoted  to  demonstrating  (41).  This  demon¬ 
stration  involves  verifying  the  two  inequalities 

(42)  [  )tfk\v(z)Lk(i)\'dt<A[  Ki“|if(oi*de 

JR*  j<3* 


and 

(43) 


/  \t\3i\U(()\ 'dt<B  [  |{|«|u(0|Jd* 
Jq *  Jr* 


where  A  and  B  are  constants  independent  of  u  and  Qn  is  the  cube 


Qn  =  {£  :  -*  <  fj  <  j  =  1 . wi¬ 


lt  should  be  clear  that  (42)  and  (43)  imply  (41). 

To  see  (42)  recall  that  |£|J‘|L*(|)|2  =  $*(0£»(0>  wbere  is  the  periodic 
function  defined  by  (3);  if  necessary,  consult  [1]  for  more  details  concerning  this 
function.  Let  Q?  =  2xj  +  Qn  and  write 


(44)  /  \tfk\U(t)Lk(()\>dt 

Jr * 


if/(oia*k(oi*m 


|£f(OI2**(Oi*«  +  2Tj)d( 


where  the  last  equality  follows  from  a  change  of  variable  of  integration  and  the 
periodicity  of  U  and  ♦».  Now  let  aj  be  the  maximum  of  Lk(£  +  2rj)  for  (  in 

Qn  and  note  that  0  <  4*(4)  =  |£|J*L*(0  <  «ol^l2*  if  £  is  in  Qn,  and  recall  that 
aj  decays  exponentially.  Thus  we  may  write 


(45) 


E 

j«z* 


|i/(01J4*(*)i*U  +  2xj)d* 


<  a0 


|£|«|tf(OIJd*. 


Formula  (44)  and  inequality  (45)  imply  (42)  with  A  —  oo 
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To  see  (43)  observe  that  for  (  in  Qn  we  may  write 

\t\u\m\2  <  m*  £  ifi«-2*j)i] 

\  jez*  / 


<  £  £  bi\t  ~  2,ril*l“(^  -  2*‘)l6jl£  -  2*3l*l«(f  -  2*j)l 

iez*  jez* 

where  to  =  1  and  otherwise  6j  is  equal  to  the  maximum  of  —  2rj|-t  over  £  in 
Qn.  Integrating  the  last  expression  involving  U  over  Qn  and  observing  that 

j  \i-  2iri|*|ti(4  -  2»i)||*  -  2xj|i|tk(£  -  2*jM  <  VM : 

Jq*  * 

where 

k-2zjn«((-2xj)rd, 

/g» 


Vj  =  (/  J*-  2rj|J*|u(£  -  2xj)|’«) 


allows  us  to  write 


(46)  /  K|J‘|C/(0|3d*  <  £  £  bib jVjVj  =  f  ^  ijKj)  . 

iez*jez»  Vjez*  / 

Note  that  2i  >  n  implies  that  the  sum  52j€z«  w  finite,  thus  by  virtue  of  (46) 
and  Schwarz’s  inequality  we  have 


(47) 

Since 


£  v-3=  /  |$i“|u(OIJ^, 


(47)  implies  (43)  with  B  =  &j- 


Proposition  8  Suppose  2k  >  n  +  1  and  u  is  in  L\(Rn).  Then  S*u  is  Lj(/2") 
and  there  is  a  constant  C  independent  of  «  so  that 

(48)  ||S*u||3,*  <  C||u||2,4 

Proof  By  Lemma  7  St  maps  the  dense  subspace  S(Rn)  of  L\{Rn)  contin¬ 
uously  into  Ll(Rn).  Let  S*  denote  the  continuous  extension  of  5*  onto  all  of 
L\(Rn).  The  proposition  will  follow  if  we  can  show  that 


(49) 

in  L\(R?)  for  all  ti  in  Ll(Rn). 


St  u  =  St  u 


To  see  (49)  let  P  and  Q  be  a  pair  of  operators  whose  existence  is  guaranteed 
by  Proposition  2.  Now  let  u  be  any  element  of  L\(Rn)  and  let  {um}  be  a 
sequence  in  S(Rn)  converging  to  u  in  Ll(Rn).  By  virtue  of  Lemma  6  the 
sequences  {QSt«m}  and  {StQum}  converge  to  QSfcii  and  StQu  respectively, 
uniformly  on  compact  subsets  of  Rn.  Since  ||QStum  -  StQum||2  t  =  0  it  follows 
that  QSkti  —  SkQu  =  p,  where  p  is  a  polynomial  in  irt-i(Rn).  Hence 

(50)  St «  -  Stu  =  q, 

where  q  is  a  polynomial  in  *>_ i(fZn).  From  (50)  it  follows  that  S*u  is  in  Ll(Rn) 
and  satisfies  (49).  ■ 


Theorem  9  The  mapping  u  — »  S*ti  is  an  orthogonal  projection  of  L\(Rn)  onto 
SHk(Rn)nLl(Rn). 

Proof  In  view  of  Proposition  8  it  suffices  to  show  that  St  is  idempotent  and 
self-adjoint. 

Since  Stu  is  a  fc-harmonic  cardinal  spline  for  any  u  in  Ll(Rn)  and,  by  virtue 
of  the  uniqueness  of  cardinal  interpolation,  S*u  =  u  for  all  u  in  SHt(Rn)<^Ll(Rn) 
it  follows  that  St(Stu)  =  Stu  for  all  u  in  Ll(Rn)  and  hence  St  is  idempotent. 

To  see  that  St  is  self-adjoint  let  u  and  v  be  any  elements  of  S(Rn)  and,  as 
in  the  proof  of  Lemma  7,  let  U  and  V  be  the  periodizations  of  u  and  t>,  namely, 

m=  £  ««-2irj) 

j  €Z* 

and  a  similar  formula  for  V.  Recall  that  Stu  —  ULt  and  |£|“L*(£)  =  <&*(£). 
use  Plancherel’s  formula  and  the  fact  that  U ,  V,  and  are  periodic,  and  write 

(Stu,v)t  =  [  \tfkU(()Lt(Z)W)<it  =  / 

Jr»  Jr • 

=  /  u(o*tW(t)dt  =  j  m*k(t)v(t)dt 

Jq »  J r* 

=  /  KI2*«(0n0^«K  =  (u,5*u>*, 

Jr » 

where  Qn  is  the  cube  {£  :  t  <  <  ir,  j  =  1, . . . ,  n).  Hence 

(51)  (Stu,v)t  =  (v,Stv)t 

holds  for  u  and  v  in  S(Rn).  Since  S(Rr')  is  dense  in  L\(Rn)  and  St  is  continuous 
it  follows  that  (51)  holds  for  all  u  and  v  in  L\(Rn)  and  thus  St  is  self-adjoint. 


Theorem  9  together  with  elementary  facts  concerning  orthogonal  projections 
on  Hilbert  spaces  imply  some  interesting  facts  concerning  fc-harmonic  splines  in 
this  class.  We  list  several  transparent  corollaries. 

Proposition  10  If  2k  >  n  +  1  then  SHt(Rn)^L\(Rn)  is  a  closed  subspace  of 
Ll{RT). 
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Proposition  11  If  2k  >  n  +  1  then  the  following  holds  for  all  u  in  L%(Rn): 

(52)  IMk*  =  lit.  -  Stu||2lt  4-  ||Siu||2ijt 
and  thus 

(53)  l|S*«lk*  <  ||u||2,i- 

Suppose  u  is  any  element  in  L\(Rn)  and  consider  the  sequence  of  values 
{u(j)}>  j  in  Zn .  We  define  M„  to  be  that  subset  of  L\{Rn)  consisting  of  those 
elements  v  such  that  t(j)  =  u(j)  for  all  j  in  Zn .  Clearly  Mu  is  an  affine  subspace 
of  Ll(Rn).  In  view  of  (53)  it  is  not  difficult  to  see  the  following  concerning  Mu 
and  S*. 

Proposition  12  If  2k  >  r»  +  l  then  there  exists  a  unique  element  w  in  Mu  such 
that 

IMk*  =  min  |H|2,i  , 

v€  M. 

and  w  =  S*u.  In  other  words,  Skit  is  the  unique  element  in  Mu  of  minimal 
L\(Rn)  norm. 

4  Cardinal  interpolation  in  Ll(Rn)  and  f\{Zn ). 

As  mentioned  in  the  introduction,  in  this  section  we  present  necessary  and 
sufficient  conditions  on  a  sequence  {vj},  j  in  Zn,  which  allow  it  to  be  interpolated 

by  the  elements  of  L%(Rn).  In  addition  the  interpolating  element  of  minimal 
Ll(R”)  norm  is  characterized. 

First  recall  the  definitions  of  the  class  T  of  finite  difference  operators  given 
earlier.  We  say  that  T  in  T  is  of  order  k  f  f(()  =  0(|£|*)  but  not  o(|£|*)  as  ( 
goes  to  0. 

Proposition  13  Suppose  2*  >  n  +  1,  u  is  in  £*(/?"),  and  T  is  any  finite 
difference  operator  of  order  >  k.  Then 

<54)  E  <  cMh 

j  6Z* 

where  C  is  a  constant  independent  of  u. 

Proof  If  u  is  in  S(Rn),  let 

U(()  =  (2t)-"/’  £  u(j)e-‘d() 

j  €Z* 

and  recall  the^  definition  of  $*(£).  By  virtue  of  Parseval’s  identity  and  the  fact 
that  |T(£)|2/$»(£)  is  bounded  we  may  write 

53iTu(j)i*  =  /  immi’x 
jcz* 

Jq» 

<  cf  \U(t)?\*k(t)\3\*k(t)\-'d( 

jQm 
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=  c  f  i^(o**(oiaKr"dc 

Jr * 

Jr' 

=  C||5t«||2>t. 

Since  ||5iu||2it  <  ||u|ki  we  may  conclude  that  (54)  holds  whenever  u  is  in 
S'(Rn).  To  see  that  (54)  holds  for  all  u  in  L2t(Rn)  let  P  and  Q  be  the  opera¬ 
tors  whose  existence  is  guaranteed  by  Proposition  2,  recall  that  Tp  =  0  for  all 
polynomials  in  ir*_i(f2n),  and  observe  that 

(55)  TQu  =  Tu 

for  all  u  in  L\(Rn).  Choose  any  element  u  in  L\(Rn),  and  let  {um}  be  a 
sequence  in  S(Rn)  converging  to  u  in  Ll(Rn).  By  virtue  of  Lemma  6  {Qum} 
converges  to  Qu  uniformly  on  compact  subsets  of  Rn  and  hence  in  view  of  (55) 
{Tun^j)}  converges  to  Tu(j)  for  all  j  in  Zn.  This  last  observation  together  with 
the  fact  that  (54)  holds  for  each  um  implies  that 

£|r«U)l2<c||<t 

where  the  sum  is  taken  over  any  finite  subset  of  Zn.  The  last  inequality  of 
course  implies  the  desired  result.  H 


We  say  that  a  finite  collection  Tm  ,  m  =  1, . . . , 
condition  r*  if 


*»(0 


N,  of  finite  differences  satisfies 


-l 


is  in  L°°(Rn).  Note  that  the  Tv  ’s  used  in  the  definition  of  t\(Zn)  enjoy  this 
property.  Also  note  that  for  every  positive  integer  k  there  is  a  finite  collection 
in  T  which  satisfies  condition  t*. 


Proposition  14  Suppose  2k  >  n  +  1,  u  is  a  sequence  in  ll(Zn),  and  fu  is  the 
unique  k-harmonic  cardinal  spline  which  interpolates  u.  Then  fu  is  in  L\(Rn) 
and 

(56)  ll/ulk»  <  C||«||M 

where  C  is  a  constant  independent  of  u. 


Proof  Suppose  u  is  in  y~°°,  then 

/«=  £ 

j  €Z* 


the  function 

m  =  £ 

j  €Z* 

is  well  defined,  and  /„  =  C/L*.  Applying  Plancherel’s  formula  and  the  fact  that 
the  collection  {V  :  |*/|  =  1}  satisfies  condition  t*  we  may  write 

tifuWU  =  /  MOMOI’lfl2*# 

Jr • 
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< 


/  mo\2*tioUtw 

Jr * 

Jq* 


c[  £ i^(o^(oia« 

•/«*  M=* 


d* 


CIMI2,*  • 


Thus  (56)  holds  for  u  in  ^-0° .  In  view  of  Propositions  3  and  4  the  desired  result 
follows  from  a  density  argument  similar  to  that  used  in  the  proof  of  Proposition 
13.  ■ 


Corollary  1  The  mapping 

{«j}  — */«•=£  “  j) 

jez* 

is  an  isomorphism  between  f*(Zn)  and  Lk(Rn)nS  Hk(Rn)  such  that 

cIMk*  <  II/uIIj,*  <  <?||u|k* 

where  c  and  C  are  positive  constants  independent  of  u. 

We  conclude  this  paper  by  summarizing  the  contents  of  the  above  two  propo¬ 
sitions  in  the  following  theorems. 

Theorem  15  Given  a  sequence  u  =  {uj},  there  is  an  element  in  Lk(Rn)  which 
interpolates  it  if  and  only  if  u  is  in  l \(Zn ). 

Combining  the  results  in  this  section  together  with  Propositions  1 1  and  12  easily 
produces  the  following  conclusion. 

Theorem  16  Suppose  u  is  in  fJ(Zn).  Then  there  is  a  unique  k-harmonic  spline 
/„  in  Ll(Rn)nSHk{Rn)  which  interpolates  u.  This  interpolant  /„  has  the  prop¬ 
erty  that 

ll/ulk*  <  Hulk* 

for  any  g  in  L\(Rn)  which  interpolates  u,  unless  g(x)  =  /„(x)  for  all  x  in 
RP.  In  other  words,  /«  is  the  unique  element  of  minimal  Ll(Rn)  norm  which 
interpolates  u. 
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Error  bounds  for  multiquadric  interpolation 


W.  R.  Madych  and  S.  A.  Nelson 
Abstract 

A  class  of  multivariate  scattered  data  interpolation  methods 
which  includes  the  so-called  multiquadrics  is  considered.  Pointwise 
error  bounds  are  given  in  terms  of  several  parameters  including  a 
parameter  d  which,  roughly  speaking,  measures  the  spacing  of  the 
points  at  which  interpolation  occurs.  These  bounds  can  be  of  arbi¬ 
trarily  high  order  in  d. 


§1.  Introduction 

To  avoid  technical  complications  which  are  not  germaine  to  the  basic 
ideas  we  restrict  the  major  part  of  this  report  to  the  following  simple  setup. 
Let  h  be  the  function  defined  for  x  in  Rn.  n  >  1,  by  the  formula 

h(x)  =  -y/l  +  \x\2  (1) 

where  \x\  is  the  Euclidean  norm  of  x.  Given  data  (xj,  fj),  j  =  1, . . . ,  N,  where 
X  =  {xi, . . . ,  xjy}  is  a  subset  of  points  in  Rn  and  the  fj'  s  are  real  or  complex 
numbers,  consider  the  function  s  defined  by 

n 

s(x)  =  Co  +  ^2  Cjh{x  -  Xj)  (2) 

j=  i 


where  the  c,-’s  are  chosen  so  that 
n  N 

X]  ci  =  0  and  c°  +  ^2  cMxi  ~  xi)  =  fiy  i  =  l,...,N.  (3) 

i= i  ;=i 

It  is  well  known  that  the  system  of  equations  (3)  has  a  unique  solution  and 
thus  the  interpolant  s(x)  is  well  defined.  Recall  that  the  system 

N 

<tjh(xi  —  Xj)  =  fi,  i  =  1, . . . ,  N,  (4) 

i=i 

Approximation  Theory  VI 

C.  K.  Chui,  L.  L.  Schumaker  and  J.  D.  Ward  (eds.) 

Copyright,  Academic  Press,  New  York,  1989,  1-  4. 

ISBN  0-12-l7585-6:  All  rights  of  reproduction  in  any  form  reserved. 


2 


W.  R.  Madych  and  S.  A.  Nelson 


can  also  be  solved  uniquely  for  the  coefficients  aj.  However  the  resulting  in- 
terpolant 

N 

5Z  aMx  -  xi) 

)= 1 

is  not  necessarily  in  the  class  .  This  class,  which  is  defined  below,  plays  an 
important  role  in  our  estimates. 

The  method  of  interpolation  (3)  or  (4)  is  often  referred  to  as  the  multi¬ 
quadric  method.  For  more  background  and  further  references  see  the  survey 
article  by  Nira  Dyn  in  these  proceedings. 

Recall  that  the  generalized  Fourier  transform  of  h  is  given  by 

C»*a(|£|) 


h(t)  = 


UP 


(5) 


where  cn  is  a  constant  which  depends  on  n,  K\  is  a  Bessel  function  of  the 
third  kind  of  order  A,  and  X  =  (n  +  l)/2.  For  example,  in  the  case  n  =  2  we 
may  write 

ut\  - 11  + 

(2»)’|f|»  '  j 

Note  that  in  the  general  case  h  has  exponential  decay  at  infinity  and  h(£)  = 
°(Urn_1)  at  the  origin. 

Set  r(£)  =  l/{U|2h(0)  an(i  let  C\  be  the  class  of  those  tempered  dis¬ 
tributions  /  whose  first  order  derivatives  have  Fourier  transforms  w  hich  are 
square  integrable  with  respect  to  the  weight  function  r(£)  over  Rr  .  Define 
ll/IU  by 


j=l  J*H 


Note  that  ||/||£  is  a  positive  semidefinite  quadratic  form  on  Ch  and  thus  ||/||fc 
may  be  regarded  as  a  seminorm  on  C*.  It  is  not  difficult  to  see  that  is 
essentially  contained  in  the  class  of  infinitely  differentiable  functions  on  Rn; 
the  definition  implies  that  derivatives  of  arbitrarily  high  order  are  square 
integrable.  Another  important  property  of  C*  is  the  fact  that  the  data  {fj} 
can  be  regarded  as  the  pointwise  restriction  of  an  element  of  C *  to  X. 

As  suggested  by  the  definition  there  is  an  intimate  connection  between 
the  class  C ^  and  the  interpolant  <(*).  We  summarize  some  of  the  properties 
which  follow  from  this  relationship. 

i.  The  interpolant  s  is  in  C\. 

ii.  If  g  is  in  Cfc  and  g(xj)  =  fj,  j  =  1, . . . ,  N,  then 


/ii.  The  function  $  is  the  element  of  minimal  C*  norm  which  interpolates  the 
data  (* j,  fj),  j  =  1, . . . , N.  In  other  words 


||*||fc  =  minM*  :  9  6  Ck  and  ?(*,)  =  /,-, 


Error  bounds  for  multiquadrics 
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§2.  Error  bounds 

Before  stating  the  basic  results  we  recall  some  technical  definitions. 

In  what  follows  the  discrete  set  X  is  always  assumed  to  be  a  subset  of  an 
open  set  ft.  Furthermore,  there  are  constants  M  and  e<>  such  that  for  every  e, 
0  <  e  <  e0, 

Q.  CU{B(x,eM)  :  x  G  fte}  (6) 

where  ft*  =  {x  6  Rn  :  B(x,e)  C  ft}  and  B(x,e)  =  {$/  6  Rn  :  \y  —  x\  <  e}. 
It  is  not  difficult  to  see  that  (6)  is  satisfied  if  ft  is  an  ellipsoid  or  parallelpiped 
in  Rn;  more  generally,  (6)  is  satisfied  if  ft  satisfies  an  interior  cone  condition. 
Finally  we  define  the  parameter  d  by 

d  =  sup  inf  |y  -  x\. 

Note  that  d  depends  on  both  ft  and  X\  it  is  a  standard  measure  of  how  well 
ft  is  covered  by  X. 

Theorem.  Suppose  f  is  in  Ch  and  f(xj)  =  fj,  j  =  1, . . .  ,N.  Given  an  integer 
k  >  1  there  are  constants  C  =  C(ib,  ft)  and  do  =  d(Jfe,ft)  such  that  if  d  <  do 
and  the  multi-index  v  satisfies  \v\  <  k  then 

\\D“(f  -  j)||r-(o)  <  c<f‘~wll/IU. 

Of  course  the  norm  on  the  left  hand  side  of  the  above  inequality  is  just 
the  usual  L°°  norm  taken  over  ft.  We  also  remind  the  reader  that,  whereas 
|x|  normally  denotes  the  Euclidean  norm  of  a:,  in  the  case  of  multi-indicies  |i/| 
denotes  the  sum  of  the  components  of  u. 

The  argument  used  to  obtain  this  theorem  can  be  outlined  as  follows. 
First,  by  virtue  of  the  properties  (i)-(iii)  listed  above,  there  is  no  loss  of 
generality  when  attention  is  restricted  to  the  case  s  =  0.  In  this  case  the  proof 
can  be  broken  down  into  four  steps. 

If  <rx  is  a  compactly  supported  Borel  measure  on  Rn  such  that  p(x)  — 
I  p(y)d<r*( y)  for  all  polynomials  p  of  degree  less  than  k  then 

l/(*)-//(y)<^»(y))  <  c!|/|U  (7) 

where  c  depends  only  on  h,  k,  and  n.  Use  reasoning  similar  to  that  used  in  [1] 
and  apply  (7)  locally  in  ft  with  <r’s  supported  in  a  (small  ball  around  *)flX 
to  conclude  that 

l/(*)l  <  CM‘||/IU  (8) 

for  all  *  in  ft.  Next,  if  /  is  in  Ch  then 

P*7IU~  <  c||/iu  0) 

for  \v\  >  1,  where  the  L°°  norm  is  over  all  of  Rn  and  c  is  a  constant  which 
depends  only  on  h ,  n,  and  u.  Finally,  ‘interpolate’  between  (8)  and  (9)  to 
obtain  the  desired  result. 

Details  can  be  found  in  (2] 
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§3.  Extensions  and  limitations 

The  error  bound  given  above  holds  for  methods  of  interpolation  of  the 
form  (2)  and  (3)  where  h  of  (1)  is  replaced  by  a  more  general  function  which  is 
condition  ally  positive  definite  of  order  m.  Of  course  the  space  Cj*  must  change 
accordingly  and  certain  limitations  on  k  may  apply. 

To  be  more  specific,  recall  that  such  an  h  uniquely  determines  a  non¬ 
negative  Radon  measure  p  on  Rn  \  {0}  with  p  =  h  on  Rn  \  {?}.  If  for  some  l , 
l  >  m,  this  measure  satisfies 

/  <  oo, 

then  the  theorem  stated  above  holds  with  the  restriction  m  <  k  <  l. 

For  example,  if  h(x)  =  (1  +  |®j2)a  where  a  is  any  fixed  real  number  which 
is  not  a  non-negative  integer  then  h  or  —  h  is  conditionally  positive  definite 
of  order  m  where  m  is  any  integer  greater  than  a.  In  this  case  the  Fourier 
transform  of  h  is  smooth  away  from  the  origin  and  decays  exponentially  at 
infinity.  Thus  (7)  holds  for  every  integer  i  and  the  appropriate  version  of  the 
theorem  holds  with  C *  defined  accordingly  whenever  the  integer  k  satisfies 
a  <  k  <  oo. 

The  discrete  set  X  need  not  be  finite  and  f l  need  not  be  bounded.  An 
important  requirement  however  is  that  the  numbers  {/,•}  be  the  values  {/(zj)} 
of  some  function  /  in  Ch-  In  the  infinite  case  this  requirement  may  not  be  so 
easy  to  verify.  Nevertheless  interesting  applications  of  this  result  can  be  had 
in  the  case  of  infinite  X ;  for  example,  in  various  so-called  cardinal  methods 
of  interpolation. 


(10) 
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On  the  Correctness  of 

the  Problem  of  Inverting  the  Finite  Hilbert  Transform 
in  Certain  Aeroelastic  Models 

W.  R.  Madych* 


Abstract 

We  indicate  methods  of  ensuring  that  problem  in  the  title  is  cor¬ 
rectly  posed  in  the  Lp  sense  whenever  the  derivative  of  the  circulation 
function  satisfies  certain  mild  conditions. 


1  Introduction 

In  the  theory  of  aeroelastic  control  systems  it  is  required  to  solve 
(1) 

for  i(y),  —  1  <  y  <  1,  in  terms  of  /(x),  —  1  <  x  <  1.  The  function  /  is 
assumed  to  be  of  the  form 


(2) 


/(x)  =  w(x)  +  s(x)  , 


where 

(3) 


G(») 

1  —  X  +  3 


ds. 


Here  w  and  G  are  constant  multiples  of  the  so-called  downwash  function  and 
the  derivative  of  the  circulation  function  respectively. 

Formula  (I)  is  often  referred  to  as  the  finite  Hilbert  transform  of  7,  see 
[3].  For  more  detail  concerning  this  model  of  aeroeiasticity  see  [1]  and  the 
references  cited  there.  In  particular,  f  —  fx  and  G  =  I\  in  the  notation  of 
[1]- 

In  order  to  guarantee  the  correctness  of  the  problem  of  solving  (1)  via  the 
methods  in  [3],  it  is  necessary  to  assume  that  /  is  in  some  Lp(— 1, 1)  class1. 
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In  view  of  this  and  the  fact  that  w  can  usually  be  taken  to  be  in  any  class 
Lp(— 1,1),  it  is  important  to  obtain  a  fairly  general  answer  to  the  following 
question:  What  conditions  on  G  ensure  that  g  is  in  Lp(— 1, 1)? 

It  is  the  purpose  of  this  note  to  point  out  certain  natural  methods  for 
obtaining  such  conditions.  Propositions  2  and  3  below  contain  several  typical 
results. 


2  Discussion 


Observe  that  the  integral  defining  g(x)  is  a  smooth  function  of  x  for  x  <  1 
whenever  G  is  locally  integrable  and  satisfies  a  mild  condition  at  infinity.  In 
particular,  it  is  clear  that  g(x)  is  infinitely  differentiable  for  x  <  1  if 


(4) 


[Q(*)t 

1  +  3 


ds  <  oo. 


In  fact,  if  0  <  x  <  1,  we  may  write 


\g(x)\  <  {\  -  x)-1  J  y^ds 
Jo  1  +  s 

and  conclude  that  the  only  questionable  behavior  of  g  occurs  in  arbitrarily 
small  neighborhoods  of  x  =  1  whenever  /  satisfies  (4). 

It  should  be  noted  that  condition  (4)  is  quite  mild  and  general.  For 
example,  if  G  —  G\  +  G2  where  G\  is  in  £*(0,  oo)  and  G2  is  in  Lp(0,oo)  for 
some  p,  p  <  oo,  then  G  satisfies  (4). 

To  understand  how  G  influences  the  behavior  of  g  in  neighborhoods  of 
i  =  l,  express  the  integral  defining  g  as  a  sum,  /□  +  /e°°,  where  e  is  any 
positive  number  <  1.  Since 


(5) 


r  g(3)  ds  <-  r |G(3)! 

Jt  1— i  +  s  —  t  Jo  1  +  s 


\G(s)\ 


ds  , 


it  should  be  clear  that  the  behavior  of  g  at  x  =  1  is  determined  by  the 
behavior  of  G  at  the  origin.  Indeed,  if  s~aG(s)  is  in  £,p(0,e)  for  some  value 
of  p,  1  <  p  <  oo,  then  by  virtue  of  Holder’s  inequality  we  may  write 

I  T^TTs  ds  -  /(I’P’“)  [/»'  >r  ■ 


(6) 

where 


\  rw  sa  Wb’-1) 

/(i'^a)-[/.  (73777)  * 

Now,  using  a  change  of  variable,  I  may  be  expressed  as 


1-1/p 


/(i,p,a)  =  (1  ~x)a~l/p 


'  re/(l—x)  / 

Jo  It 


sa  \p/(p- 1) 

"+7/ 


ds 


1-1/p 
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from  which  we  may  easily  estimate  its  size. 

We  summarize  these  observations  as  follows: 

Proposition  1  Suppose  g  is  related  to  G  via  (3),  G  satisfies  condition  (4), 
and  s~aG(s )  is  in  Lp( 0,  e)  for  some  positive  e,  some  a,  a  >  0,  and  some  p, 

1  <  p  <  oo.  Then  for  —  1  <  x  <  1 

C(  l  —  x)a~1lp  ifa<l/p 

(7)  |fif(x)|  <  -  C(1  +  log(l  -  x)  )  if  a  =  1/p 

C  if  a  >  1/p 

where  C  is  independent  of  x. 

A  result  concerning  the  Lp  class  of  g  follows  as  an  immediate  corollary. 

Proposition  2  Suppose  G  and  g  satisfy  the  hypothesis  of  Proposition  1.  If 
a  >  1/p  then  g  is  in  Lq(— 1,1)  for  all  positive  q.  If  a  <  1/p  then  g  is  in 
Lq(— 1, 1)  for  all  positive  q  which  satisfy  q  <  p/(l  —  ap). 

By  using  a  slightly  more  delicate  argument,  the  inequality  q  <  p/(  1  —  ap) 
in  the  second  half  of  the  above  proposition  can  be  tightened  to  q  <  p/(l  —  ap) 
in  the  case  1  <  p  <  oo.  To  see  this,  use  the  fact  that  if  a  >  0  and  x  <  1  then 


( - - - Y  <  1 

VI  —  x  +  s) 


to  observe  that 


where 


Jo  1  - 


X  +  s 


ds  </aG“(x-  1) 


Io<t>{y)  =  [°°  —  ds 

J —oo  s  —  y 

is  the  classical  Hilbert  transform  of  <f>  and,  when  a  >  0, 


»^(y)  =  / 

J  —  0 


y-oo|s-y|‘-° 

is  the  fractional  integral  or  Riesz  potential  of  <j>.  Here 


->ar/  \  _  f 

0 


G(s)\  if  0  <  s  <  e 
0  ifs<0ors>e. 


The  mapping  properties  of  the  transformation  <j>  — *  Ia<t>  are  well  known 
and,  in  view  of  (8),  can  be  used  to  make  conclusions  concerning  the  behavior 
of  g.  For  instance,  if  1  <  p  <  oo,  0  <  a  <  1/p,  and  <f>  is  in  Lp{- oo,  oo)  then 
Ia4>  is  in  Lq(- oo,oo)  where  q  =  p/(  1  —  ap);  see  [2].  This  together  with  (5), 
(8),  and  Proposition  1  allows  us  to  conclude  the  following: 
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Proposition  3  Suppose  G  and  g  satisfy  the  hypothesis  of  Proposition  1  with 
the  restriction  that  1  <  p  <  oo  and  0  <  a  <  1/p.  Then  g  is  in  Lq{—  1, 1)  for 
all  positive  q  such  which  satisfy  q  <  p/(  1  —  op). 

Another  method  of  estimating  the  left  hand  side  of  (8)  involves  writing 
Jo  35  /o(1“x)  +  I(i- x)  when  1  —  x  <  e,  using  the  change  of  variables  y  =  1  —  x, 
and  applying  variants  of  Hardy’s  inequality,  see  [2]  page  245,  to  each  of  the 
resulting  integrals.  This  leads  to  generalizations  of  Proposition  1  for  certain 
values  of  the  parameters  a  and  p. 

For  the  sake  of  completeness  we  mention  that,  using  similar  methods 
involving  fractional  integrals,  it  is  possible  to  obtain  results  concerning  the 
behavior  of  g  in  neighborhoods  of  1  for  other  values  of  the  parameters  a  and  p. 
Since  such  estimates  require  the  introduction  of  certain  technical  machinery 
and  the  conclusions  do  not  involve  Lp ,  we  will  not  pursue  the  details  here. 

It  may  be  worth  noting  that  in  the  notation  of  [l]  G(s)  is  equal  to  ip(t  —  s) 
for  t  <  s;  it  is  equal  to  another  expression  when  s  <  t.  Furthermore  is 
assumed  to  be  in  Ll(—oo,  0).  In  this  case  our  observations  imply  that  if  t  >  0 
then  xf  does  not  affect  the  Lp  class  of  /*.  This  should  be  compared  with  the 
conclusions  in  [1]. 
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Cardinal  Interpolation  with  Polyharmonic 

Splines 

W.  R.  Maclycli* 


1  Introduction 

If  A:  is  a  positive  integer  an  u-variate  k-harmonic  cardinal  spline  is  a  tempered 
distribution  /  on  Rn  such  that  A k  f  is  a  measure  supported  on  the  integer  lattice 
Zn  in  Rn.  Symbolically 

(1)  AA/(. v)=  £  a}f(x-j) 

where  A  is  the  n  variate  Laplacian,  A1'  =  AAi_l  for  fc  >  1,  and  6(x)  is  the  unit 
Dirac  measure  supported  at  the  origin.  A  polpharmonic  spline  is  one  which  is 
A- harmonic  for  some  k. 

The  most  important  use  of  these  distributions  involves  the  interpolation  of 
data  {tij}  defined  on  Zn  to  all  of  Rn.  Thus  the  cardinal  interpolation  problem 
for  A-harmonic  splines  is  the  following:  given  a  sequence  {uj}  defined  on  Zn 
find  a  A-harmonic  spline  /  such  that 

(2)  /( j)  =  Mj 

for  all  j.  Besides  the  basic  questions  of  existence  and  uniqueness  other  mean¬ 
ingful  questions  concern  the  behavior  of  the  spline  interpolant  in  terms  of  the 
data  and  the  ellect  of  the  parameter  A. 

In  the  univariate  case,  n  =  1,  these  splines  are  exactly  the  polynomial  car¬ 
dinal  splines  of  odd  degree  ami  polynomial  growth  studied  by  Schoenberg,  [20]. 

It  is  the  purpose  of  this  note  to  describe  the  properties  of  these  splines  in  the 
general  n- variate  case.  Except  for  the  existence  of  B-splines,  these  properties 
are  remarkably  similar  to  tho-e  found  in  the  univariate  case. 

Some  of  these  results  were  originally  announced  in  [10]  and  amplified  in  [11] 
where  motivation  and  other  background  is  given.  Here  we  only  mention  that  the 
distributional  definition  of  these  splines  which  is  given  above  is  motivated  by 
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the  facts  that  it  is  very  convenient  and  easily  allows  for  the  unrestrained  use  of 
Fourier  transforms.  Thus  in  a  certain  sense  this  development  may  be  regarded 
as  an  extension  of  the  early  work  of  Schoenberg  [19]  which  used  Fourier  analysis. 

Recall  that  the  classical  univariate  cardinal  splines  of  degree  2k  —  1  and 
polynomial  growth  may  be  viewed  as  linear  combinations  of  translates  of  |x|2fc_1. 
Similarly  the  general  Ar-harmonic  cardinal  spline  /  may  be  regarded  as  a  linear 
combination  of  translates  of  the  fundamental  solution  of  Ak  denoted  by  Ek(x ); 
thus  AkEk(x)  =  6(x)  and 

(3)  /(.r)=  £  ajEk(x-j). 

j  eZ" 

Note  that  at  this  point  the  correspondence  between  (1)  and  (3)  is  merely  sym¬ 
bolic;  clearly  (1)  is  meaningful  in  the  tempered  distribution  sense  for  any  se¬ 
quence  {<ij}  of  polynomial  growth  whereas  this  is  not  so  apparent  for  (3). 

Interpolation  in  terms  of  linear  combinations  of  translates  of  a  fixed  func¬ 
tion  h  is  certainly  very  appealing.  It  arises  naturally  when  the  interpolants 
are  solutions  of  certain  variational  problems:  the  general  idea  goes  at  least  as 
far  back  as  that  of  the  reproducing  kernel  Hilbert  space,  for  example  see  [1,8], 
but  the  first  meaningful  use  of  the  Fourier  transform  in  this  context  seems  to 
be  due  to  Duchon,  [6];  usually  in  such  cases  h  is  the  fundamental  solution  of 
an  appropriate  differential  or  pseudo-differential  operator  and  the  interpolant  is 
often  further  modified  in  some  way  to  account  for  various  auxiliary  conditions 
and  restrictions,  for  example  see  [6,7,13,15.17,21]  and  the  appropriate  references 
therein.  The  classes  of  posit  ive  definite  and  conditionally  positive  definite  func¬ 
tions  provide  a  rich  collection  of  examples  of  /i’s  which  can  be  used  for  such 
interpolation;  various  dilates  of  the  Gaussian  exp(  — |x|2),  the  so-called  multi¬ 
quadric  ^1  -f  |x|2,  and  the  fundamental  solution  Ek(x),  2k  >  n+  1,  are  specific 
examples;  for  for  details  and  more  examples  sec  [2,7,13,16].  When  the  data  is 
given  on  a  lattice  the  univariate  B-splines  arc  perhaps  the  most  popular  exam¬ 
ple  of  such  /i’s,  see  [20, IS]:  the  recently  developed  theory  of  box  splines  seems 
to  be  an  attempt  to  generalize  this  concept  to  the  multi-variate  case,  see  [3,5] 
and  the  pertinent  articles  in  this  volume. 

The  notation  used  here  is  standard,  if  necessary  see  [11]  for  a  more  detailed 
explanation.  Here  wc  merely  remind  the  reader  that  there  are  several  common 
normalizations  for  the  Fourier  transform.  In  this  note  we  use 

c*(s )  =  (2-)-"/-  [  c-(,r)e-«a>c/.r 
JR" 

for  the  Fourier  transform  r  of  a  test  function  y. 

2  Basic  properties 

Suppose  J  is  a  Ar-harmonic  cardinal  spline.  Then  /  is  clearly  analytic  on  Rn\Zn 
and,  in  order  to  ensure  that  point  evaluation  on  Z"  is  meaningful,  we  assume 


that  /  is  continuous  on  all  of  Rn.  In  this  case,  if  2k  <  n  +  1  it  is  well  known 
that  /  must  be  a  fc-harmonic  polynomial;  this  follows  from  the  behavior  of  the 
corresponding  fundamental  solution  at  the  origin,  see  [9]  for  details.  Now,  the 
class  of  fc-harmonic  polynomials  is  too  exclusive  to  interpolate  a  sufficiently 
broad  class  of  data  {t/j}  on  Zn.  For  example,  it  is  not  difficult  to  see  that  there 
is  no  A:-harmonic  polynomial  /  such  that  /( 0)  =  1  and  /( j)  =  0  for  j  in  Zn\  {0}. 
For  this  reason  we  restrict  our  attention  to  the  case  2k  >  n  +  1  in  what  follows. 

Let  SHk(Rn)  denote  the  class  of  fc-harmonic  splines  on  Rn  and  recall  that 
Ck(Rn)  is  the  class  of  functions  which  are  k  times  continuously  differentiable 
on  Rn. 

Proposition  1  If  2k  >  n  +  1  and  f  is  in  SIIk{Rn)  then  f  is  in  C'2k~n~1(Rn). 

Recall  that  a  sequence  {wj}  is  of  polynomial  growth  if  there  are  constants  c 
and  p  such  that 

(4)  N<c(i  +  L/|)' 

holds  for  all  j  in  Zn.  The  class  y01  is  the  collection  of  those  sequences  for  which 

(4)  holds  for  p  =  a.  Similarly  a  continuous  function  /  is  of  polynomial  growth 
if  there  are  constants  c  and  p  such  that 

(5)  |/(x)|<c(l  +  |i|)" 

holds  for  all  x  in  Rn.  The  class  5//jf(/Zn)  is  the  collection  of  those  fc-harmonic 
splines  for  which  (5)  holds  for  p  —  a. 

Proposition  2  If  2k  >  n  +  1  and  f  is  in  SIIk(Rn)  then  f  is  of  polynomial 
growth.  In  other  words  S'HK{Rn)=  [J$  IIk(Rn)  where  the  union  is  taken  over  all 
a  <  oo. 


The  last  proposition  implies  that  in  the  univariate  case  the  class  SHk{R)  is 
not  quite  as  general  as  the  corresponding  class  considered  by  Schoenberg. 
It  fails  to  contain  the  subspace  of  S?k-i  consisting  of  the  null-splines,  see  [20, 
Lecture  4,  Section  3]. 

Since  the  elements  of  SIIk(R‘l)  are  of  polynomial  growth  it  is  clear  that 
in  order  for  cardinal  interpolation  problem  to  have  a  solution  a  necessary  re¬ 
quirement  on  the  data  sequence  is  that  it  also  be  of  polynomial  growth.  As  we 
shall  see  this  requirement  is  also  sufficient.  We  begin  by  first  considering  the 
fundamental  functions  of  interpolation. 

Consider  the  distribution  which  is  defined  by  the  formula  for  its  Fourier 
transform: 


(6) 


Lk(a  =  (2x)-n/2 


kT2i 


£j €2“  i£-2srj|-2fc' 


If  k  is  an  integer  such  that  2k  >  n  +  1  then  Lk(x)  is  well  defined  as  an  absolutely 
convergent  integral. 


Proposition  3  Let  Lk  be  defined  by  the  formula  for  its  Fourier  transform  (6), 
where  k  is  an  integer  which  satisfies  2 k  >  n  +  1.  Then  L *  has  the  following 
propei'ties: 

(i)  Lk  is  a  k-liannonic  cardinal  spline. 


(ii)  For  all  j  in  Zn 

(<) 


^•u) 


1  if  j  =  0 
0  if  j  ?  0 


(Hi)  There  are  positive  constants  /l  and  a,  depending  on  n  and  k  but  independent 
of  x,  such  that 

(8)  \Lk(x)\  <  Aexp(— a|.r|) 
for  all  x  in  Rn. 

(iv)  Lk  has  the  following  representations  in  terms  of  Ek: 

(9)  /-*(*)=  E 

j  6Zn 

where  the  aj  s  satisfy  |«j|  <  /Jexp(  — 6|j|)  and  the  positive  constants  B  and  b 
depend  only  on  n  and  k.  The  series  converges  absolutely  and  uniformly  on  all 
compact  subsets  of  Rn . 

Item  (i)  is  a  readily  transparent  consecptence  of  the  definition  while  item  (ii) 
easily  follows  from  the  fact  that  for  j  in  Zn 

(10)  Lk{ j)  =  /  e'UO# 

2~  jQn 

where 

Qn  =  {£  =  if . &,)  :  --  <  &  <  j  =  1 . n}. 

The  remaining  items  are  consequences  of  the  analyticity  of  Lk. 

The  following  theorem  concerns  the  cardinal  spline  interpolation  problem 
and  the  nature  of  its  solution.  It  is  essentially  a  routine  consequence  of  Propo¬ 
sition  3  except  for  the  uniqueness  assertion.  Details  may  be  found  in  [11]. 

Proposition  4  If  {uf),  j  in  Zn,  is  a  sequence  of  polynomial  growth  and  2k  > 
n  +  1  then  the  following  is  true: 

(i)  There  is  a  unique  k-luirmonic  spline  f  such  that  /(j)  =  Uj  for  all  j. 

(11)  //uj  is  in  ya  then  f  is  in  S I Tk{ IT1). 
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(Hi)  Every  k-harmonic  .spline /has  a  unique  representation  in  terms  of  translates 
of  Lk,  namely 

(11)  f(-r)=  £  /(j)M^-j). 

j€Z'‘ 

The  expansion  (11)  convciycs  absolutely  and  uniformly  in  every  compact  subset 
of  Rn. 

3  Other  Properties 

Having  given  the  basic  existence  and  uniqueness  result  concerning  the  cardinal 
interpolation  problem  for  A'-hannonic  splines  we  briefly  address  the  following 
questions: 

How  is  the  behavior  of  the  data  sequence  {ttj}  reflected  in  the  behavior  of  its 
k-harmonic  spline  interpolant ? 

Most  of  the  results  known  in  the  univariate  case  have  an  appropriate  ana¬ 
logue  in  the  general  case.  For  example,  item  (ii)  of  Proposition  4  addresses  this 
question.  Other  results  include  appropriate  analogues  of  [4];  namely,  if  {uj}  or 
certain  finite  differences  of  it  aroin  Cp[Zn)  the  the  corresponding  Ar-harmonic 
spline  interpolant  or  appropriate  derivatives  are  in  Lp(Rn). 

What  about  the  variational  properties  of  these  splines? 

The  appropriate  analogue  of  results  cited  in  [20,  Lecture  6,  Section  1]  hold 
in  the  general  case.  See  [12]  for  details. 

[f  the  data  sequence  is  fixed  what  is  (he.  behavior  of  the  cardinal  k-harmonic 
spline  interpolant  as  k  — *  oc. 

Again,  most  of  the  results  which  hold  in  the  univariate  case  have  an  appro¬ 
priate  analogue  here.  A  result  which  seems  to  be  new  even  in  the  univariate 
case  is  the  following:  Suppose  /  is  such  that  the  support  of  /  is  in  Qn  and  Sk 
is  its  cardinal  fc-hannonic  spline  interpolant.  namely,  j)  =  /( j)  for  j  in  Zn. 
Then  if  /  satisfies  a  mild  condition  in  a  neighborhood  of  the  boundary  of  Qn 
then 

lim  Sfc(.r)  =  f(x) 

/.  —  •X 

uniformly  on  compact  subsets  of  R“.  For  some  details  see  [I4j. 

Suppose  s(x)  is  the  k-harmonic  spline  interpolant  of  f  on  the  dilated  lattice 
aZn.  What  is  the  deyrn  <>(  approximation  in  terms  of  a? 

Recall  that  s(x)  reproduces  any  A'-harmonic  polynomial;  in  particular,  it 
reproduces  any  polynomial  of  degree  <  2k  —  1.  This  together  with  routine 
arguments  involving  (8)  implies  that  j.-(.r)  — /(.c)|  =  0(a2k )  as  a  — ►  0  whenever 
/  is  in  C2k(Rn)  with  bounded  derivatives  of  order  2k.  Similar  results  hold  with 
Lp  norms.  Interpolation  arguments  imply  appropriate  results  for  less  regular 
/‘s.  Thus  appropriate  analogues  of  all  the  univariate  results  hold  in  the  general 
case. 

What  about  mum  nml  nnph  m<  ntnhons? 


•j 


The  fundamental  spline  Lk(x)  can  be  easily  evaluated  quite  rapidly  and 
accurately  via  the  fast  Fourier  transform.  See  Figures  1  and  2  In  view  of  this 
the  computation  of  most  ^--harmonic  spline  interpolants  should  should  pose  no 
significant  difficulties. 

What  about  further  generalizations'? 

There  are  many  directions  in  which  one  can  extend  certain  aspects  of  this 
theory.  For  example,  by  replacing  j£]-2fc  and  its  periodization  in  formula  (6) 
by  an  appropriate  function  6  which  decays  sufficiently  fast  at  oo  it  is  readily 
transparent  that  the  corresponding  analogue  of  L;.,  call  it  L,  will  be  continuous, 
will  certainly  satisfy  (10).  and  thus  will  also  satisfy  (7).  If  <f>  is  sufficiently 
regular  then  L  will  have  corresponding  decay  properties  at  oo.  In  view  of  this 
it  is  quit  natural  to  consider  interpolants  of  the  form 

fir)  =  Y.  /( j)£(*-j). 

jez" 

Typical  6's  for  which  the  basic  properties  of  the  above  type  interpolants  are 
particularly  transparent  arc  o(£)  =  P(£)-1  where  P(()  is  a  homogeneous  elliptic 
polynomial  of  sufficiently  high  degree  and  <?(£)  =  <7(|f|2)  where  g(Q  is  a  is  a 
univariate  function  which  is  analytic  away  from  the  origin  and  decays  sufficiently 
fast  at  oo  on  the  real  axis.  For  some  details  in  the  second  case  see  [2,7], 

Another  direction  in  one  could  consider  extensions  is  the  replacement  of 
the  lattice  Zn  by  a  more  general  discrete  set  .V.  The  case  when  X  is  finite  is 
essentially  treated  in  [0,15.17],  The  general  infinite  case  is  not  so  clear. 
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Abstract 

We  outline  a  general  procedure  for  reconstructing  data  from  measure¬ 
ments  based  on  a  linear  model.  Roughly  speaking,  the  method  involves 
the  construction  of  a  Hilbert  space  on  which  the  measurement  functionals 
are  continuous;  the  desired  estimator  is  then  simply  the  minimum  norm 
solution  in  this  space.  Under  certain  conditions  this  construction  results 
in  a  reproducing  kernel  Hilbert  space.  An  application  to  seismic  borehole 
tomography  is  included  to  illustrate  the  method  and  its  uses. 

1  Introduction. 

In  various  circumstances  one  obtains  data  concerning  a  given  quantity  with 
the  objective  of  determining  certain  features  of  that  quantity.  If  one  cannot 
measure  the  desired  features  directly  then  these  features  must  be  determined  or 
approximated  from  indirect  measurements.  The  case  of  indirect  measurement 
raises  a  host  of  interesting  questions  and  problems,  some  of  which  can  be  roughly 
summarized  as  follows; 

•  Do  the  measurements  determine  the  desired  features  uniquely? 

•  If  not,  then  how  well  can  one  approximate  the  desired  features  from  the 
measurements? 

•  Give  a  constructive  method  for  determining  or  approximating  the  desired 
features  from  the  measurements. 

It  is  the  purpose  of  this  note  to  address  the  third  item  on  this  list  when  the 
relationship  between  the  desired  quantity  and  the  measurements  is  linear.  The 
first  two  items  are  treated  only  incidentally. 

'Partially  supported  by  a  grant  from  the  Air  Force  Office  of  Scientific  Research,  AFOSR- 
86-0148 
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Observe  that  these  questions  are  essentially  mathematical  in  nature  and  can¬ 
not  be  effectively  addressed  without  a  mathematical  model  relating  the  mea¬ 
surements  to  the  desired  features.  The  general  setup  is  as  follows: 

The  measurements  are  a  collection  of  scalars,  f\, . . . ,  /„,  which  are  function¬ 
als  of  a  phantom  /,  the  desired  or  unknown  quantity.  In  particular  if  we  call 
these functionalsfj,...,fn,  then  f\  —  l\{  f  ),■■■,  fn  =  fn(/)-  The  desired  quan¬ 
tity  may  be  the  phantom  f  itself  or  certain  features  of  /  which  may  be  modeled 
by  other  functionals  of  /.  Of  course  in  most  instances  one  can  only  hope  to 
reconstruct  an  approximation  of  /  or  such  functionals.  In  what  follows  we  will 
denote  such  an  approximation  of  /  by  /. 

In  the  case  when  the  functionals  are  linear  and  are  continuous 

on  some  Hilbert  space  H,  which  presumably  contains  the  phantom,  a  popular 
and  natural  choice  for  /  is  the  orthogonal  projection  of  /  onto  the  subspace 
generated  by  these  functionals.  This  projection  can  be  computed  from  the  given 
data  by  well  known  methods  and  has  several  interesting  properties.  Perhaps  the 
most  significant  of  these  is  the  fact  that  the  mapping  (/j, . . . ,  /„)  — *  /  is  linear. 
Furthermore  this  projection  is  that  unique  element  of  minimal  H  norm  which 
satisfies  the  data  and  the  resulting  estimator  is  optimal  in  a  certain  sense,  see 
[4]  and  [8j.  .. 

Unfortunately,  in  many  circumstances,  the  linear  functionals  are  not  contin¬ 
uous  on  some  obvious  Hilbert  space  nor  is  the  phantom  necessarily  a  member 
of  such  a  space.  In  this  paper  we  address  a  fairly  common  situation  of  this  type 
which  may  be  described  abstractly  as  follows. 

The  phantom  /  is  an  element  of  some  ambient  linear  space  W  and  the  set 
{/i,  ■••>£«}  is  a  collection  of  linearly  independent  linear  functionals  defined  on 
a  linear  subspace  of  W  which  contains  /.  The  collection  {4>j},  j  =  1, . . . ,  is  a 
complete  orthonormal  set  in  some  Hilbert  space  H  such  that  is  a  well 

defined  scalar  for  all  j  and  k.  Of  course  H  is  assumed  to  be  a  subspace  of  W 
but  the  linear  functionals  are  not  assumed  to  be  continuous  on  H.  The  values 
•  •  •  .fn(/)  are  known  and  the  problem  is  to  find  an  approximation  /  of  /. 

In  this  case,  motivated  by  the  continuous  example,  we  construct  a  Hilbert 
space  “H\  on  which  the  linear  functionals  l\ , . . . ,  tn  are  continuous  and  take  the 
approximation  /  of  /  to  be  the  orthogonal  projection  of  /  onto  the  subspace 
generated  by  these  functionals  in  7i i .  The  details  of  this  construction  and  its 
properties  are  given  below  in  section  2. 

We  indicate  the  connection  between  our  approach  and  the  theory  of  repro¬ 
ducing  kernel  Hilbert  space  in  the  first  subsection  of  the  third  and  final  section. 
An  application  of  the  method  to  a  model  of  seismic  borehole  tomography  is 
given  in  subsection  3.2. 

We  wish  to  thank  Israel  Koltracht  who  showed  us  the  results  of  as  yet  unpub¬ 
lished  and  ongoing  work  concerning  the  null  space  of  the  matrix  M  mentioned 
in  connection  with  the  basis  defined  by  equation  (31)  in  subsection  3.2. 
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2  Details. 

First  we  summarize  the  basic  setup. 

•  W  is  a  linear  space  which  contains  the  phantom  /. 

•  ^1,^2,  •••,  is  a  complete  orthonormal  set  in  a  Hilbert  space  ft.  ft  is  a 
subspace  of  VV. 

•  t\ . tn  is  a  collection  of  linearly  independent  linear  functionals  such 

that  is  a  well  defined  scalar  for  each  1 fc  and  j.  In  particular,  we 

assume  that  the  n  sequences  {f*(^i),f*(^2)>  ■  ■  •}  are  linearly  independent; 
furthermore,  lj{f)  is  a  well  defined  scalar  for  each  j.  In  other  words,  / 
and  the  sequence  ,  ^2, . . are  in  the  domain  of  each  tj. 

We  emphasize  that  the  functionals  tj  are  not  necessarily  defined  on  all  of  W  or 
ft  and  of  course  they  are  not  necessarily  continous  on  ft.  Also,  /  is  not  assumed 
to  be  in  ft. 

The  problem  we  address  below  is  the  following: 

Given  the  values  tx(f), . . . ,  /„(/)  find  an  estimator  /  of  /. 

As  is  customary,  symbols  (/,  g )  denote  the  inner  product  of  two  elements,  / 
and  g,  in  ft  and  /,  =  (f,4>j),  j  =  1,2,...  .  Thus  {/x, is  the  sequence 
of  Fourier  coefficients  of  /  with  respect  to  the  complete  orthonormal  system 
,  4*2 1  •  *  • ,  and  ft  may  be  regarded  as  a  collection  of  such  sequences  via  the 
standard  identification.  The  norm  ||/||  of  an  element  f  of  ft  is  defined  by  ||/||J  = 
(/,  /)  of  course.  In  the  discussion  below,  we  assume  the  field  of  scalars  to  be 
the  complex  numbers. 

2.1  Simple  interpolation. 

Consider  the  matrix 

(1)  M  =  (ti(4>j))  ,  i,j  =  1,. . . ,n. 

This  matrix  is  not  necessarily  invertible  in  the  general  case.  However,  in  view 
of  the  fact  that  the  sequences  tj(4>2)<  •••},  j  =  are  linearly 

independent,  it  should  be  clear  that,  by  reordering  the  4>j ’s  if  necessary,  M  has 
a  non-zero  determinant  and  hence  is  invertible. 

In  any  case,  if  Af  is  not  singular,  we  can  always  find  an  element  /  which 
satisfies 

(2)  **(/)  =  /*(/).*=  1 . . 

by  simply  setting 

(3)  /=£>*> 

;'=i 
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where  the  a/s  are  scalars  which  satisfy  the  system  of  equations 

n 

(4)  =  £k(f)  ,  k  = 

1=1 

Since  M  is  invertible,  a  unique  set  of  such  a; ’s  exists. 

Note  that  this  method  can  be  applied  even  if  the  basis  elements  fa , . . . ,  <j>„ 
are  not  necessarily  orthogonal  as  long  as  the  corresponding  matrix  M  given 
by  (1)  is  not  singular.  The  resulting  estimator,  /  is  a  simply  a  linear  com¬ 
bination  of  fa,...,4n  _which  interpolates  the  data  A(/)» . . .  ,  A>(/),  namely, 
A (/)  =  A(/).  •  •  •  i  Ai(/)  =  A(/)-  The  properties  of  such  a  solution  depend 
on  the  relationship  between  /,  the  I’s,  and  fas  and  are  not  well  documented  in 
the  general  case. 

In  the  development  below  we  give  an  alternate  method  for  computing  an 
approximant  /  in  the  general  case. 

2.2  A  Hilbert  Space  Approach. 

Let  hj,  j  =  1,2, ... ,  be  a  sequence  of  non-negative  real  numbers  such  that 

(5)  £>il4(*,)l*  <  oo 

jal 

for  all  k.  Set  wj  =  h~l  and  consider  the  subspace  Hx  of  H  consisting  of  those 
elements  /  for  which 


is  finite.  (In  the  case  hj  =  0  the  term  |/;|2u>;  is  taken  to  be  zero  if  fj  is  zero; 
otherwise  it  fails  to  be  finite.)  The  Hilbert  space  H\  is  the  completion  of  H\  in 
the  norm  ||/||i  defined  by  (6).  The  inner  product  in  ‘Hi  is  given  by 

(7) 

i= i 

Proposition  1  The  linear  functionals  ti, ...  ,tn  are  continuous  on  Hi . 

Proof  For  /  in  H\  we  may  write 

l'.(/)l  =  I 

<  (ET-i M*,)'1' (E“, 
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Proposition  2  If  the  sequence  hj,  j  =  1,2,...,  is  bounded  then  Hi  is  a  sub- 
space  ofH.  If,  in  addition,  all  the  hj 's  are  non-zero,  then  Hi  is  dense  in  H  and 
the  set  li, ...  ,t„  is  linearly  independent  in  Hi . 

Proof  To  see  the  first  statement  simply  write 

ll/ll3  =  Y  l/il*  ^  "““(MU  \fs?wi  =  m<*x{Mll/lli  • 

i=i  i=i 

The  second  statement  follows  from  the  fact  that  the  subspace  consisting  of  those 
/’ s  which  have  only  a  finite  number  of  non-zero  Fourier  coefficients  is  dense  in 
both  Hi  and  H.  ■ 


Recall  that  if  /  is  a  continuous  linear  functional  on  H\  then  there  is  an 
element  gt  of  Hi  so  that  1(f)  =  (/,  gt)i.  In  fact  we  may  identify  t  with  gi. 
Doing  so,  it  is  clear  that 

(8) 

i=l 

for  k  =  1, . . . ,  n.  These  series  converge  in  Hi  by  virtue  of  (5).  Furthermore,  if 
the  A’s  are  bounded  then  these  series  also  converge  in  H.  The  scalar  product  of 
f*  and  lm  in  Hi  is  given  by 

00 

(9)  =  £5PJT*m(*f)A>- 

is  i 

Note  that  the  collection  1 i,...,ln  is  not  necessarily  linearly  independent  as 
a  subset  of  H\ ;  this  depends  on  the  choice  of  the  h’s.  However  the  h’s  can 
always  be  chosen  so  that  li,...,tn  is  linearly  independent  and,  in  what  follows, 
we  always  assume  that  this  is  the  case.  In  particular  the  matrix 

(10)  l  =  ((<*,  tm)i) 

whose  elements  are  defined  by  (9)  is  not  singular  and  is  positive  definite. 

Let  a(/)  be  defined  by  the  formula 

(11)  «(/)  =  f>*4 

Sal 


5 


where  the  coefficients  a*  are  computed  from  the  data  A (/), . . . ,  tn(f)  by  solving 
the  system  of  linear  equations 
n 

(12)  <*»{&,  An) i  =  An(/)  ,  m  = 

*=i 

Since  L  is  not  singular  there  is  a  unique  set  of  a*’ s  which  satisfies  (12)  and  thus 
«(/)  is  well  defined.  Observe  that 

(13)  An(*(/))  =  W),A»)  =  An(/) 
for  m  =  1, . . . ,  n. 

In  view  of  (13)  we  now  have  a  method  for  constructing  an  estimator  /  of  /, 
namely  /  =  «(/).  Furthermore,  if  we  choose  to  regard  /  as  an  element  of  Hi 
then  it  is  clear  that  s(/)  is  simply  the  orthogonal  projection  of  /  onto  S  in  H\. 
Here  5  denotes  the  subspace  of  H\  spanned  by  t\, . . . ,  A»- 

2.3  A  biorthogonal  representation. 

A  particularly  elegant  way  of  representing  s  (/)  is  in  terms  of  elements  A  i , . . . ,  A„ 

which  are  biorthogonal  to  A . tn  in  5. 

Recall  that  a  collection  Aj, . . . ,  An  is  said  to  be  normalized  biorthogonal  to 
ii . A,  in  5  if  it  is  a  subset  of  5  and 

(14)  (Ay , A)i  =  Sjit  ,  j,k  =  1,. .  ■  ,n 

where  tfy*  is  the  Kronecker  delta.  Here  S,  the  subspace  spanned  by  . . . ,  A>. 
is  regarded  as  a  closed  sub., pace  of  Hi  whose  inner  product  coincides  with  that 
of  Hi. 

If  A|,...,An  is  normalized  biorthogonal  to  in  5  then  it  easy  to 

check  that 

n 

(15)  As  =  ^ bkjfj  ,  k=  l,...,n. 

i- * 

The  coefficients  6»y  can  be  found  by  solving 

n 

(16)  1)  ’  An)  1  =  &km  >  k,  m  —  1, . . . ,  n, 
i=i 

in  other  words,  the  matrix  (6*y)  is  simply  L~l  where  L  is  given  by  (10).  In 
terms  of  such  A*’s  »(f)  has  the  representation 

(17)  *(/)  =  £<*(/)  A*. 

*=i 

It  should  be  mentioned  that  in  spite  of  the  fact  that  representation  (17)  is 
elegant,  in  specific  examples  it  may  be  awkward  to  use  and  other  representations 
may  be  more  convenient.  This  will  be  illustrated  in  the  examples  below. 
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2.4  Questions. 

Now  that  we  have  a  method  for  constructing  an  approximation  /  of  /,  namely 
/  =  *(/)> two  questions  need  attention:  (i)  What  is  the  relationship  between  / 
and  /?  (ii)  What  difficulties,  if  any,  are  there  in  computing  /? 

From  the  practical  viewpoint  the  second  question  seems  more  significant  than 
the  first.  For  instance,  if  the  approximant  is  essentially  impossible  to  compute 
with  any  level  of  accuracy  then  questions  involving  degree  of  approximation 
are  primarily  of  academic  interest.  On  the  other  hand,  it  seems  that  the  first 
question  should  not  be  completely  ignored,  even  in  the  applied  setting;  certainly 
it  must  be  of  some  significance  to  know  relationships  between  the  computed 
quantity  and  the  desired  solution. 

In  our  setup  the  answer  to  the  second  question  depends  on  the  conditioned¬ 
ness  of  the  matrix  L  defined  by  (10)  and  the  ease  and  accuracy  at  which  (11) 
can  be  evaluated.  Any  questions  concerning  computability  depend  on  the  spe¬ 
cific  choice  of  V s,  <(>' s,  and  h's  and  is  very  difficult  to  address  in  the  general 
case.  Furthermore,  it  should  be  mentioned  that  these  can  be  controlled  to  some 
extent. 

A  quantity  which  is  essential  in  addressing  the  first  question  is  /  which  is 
often  completely  or  partially  unknown.  On  the  other  hand,  it  is  possible  to 
obtain  error  estimates  in  terms  of  certain  nonlinear  functionals  of  /.  These 
nonlinear  functionals  include  various  norms  of  /  and  may  vary  from  case  to 
case.  For  a  nice  discussion  concerning  the  type  of  information  needed  to  obtain 
estimates  of  accuracy  in  many  of  the  classical  approximation  problems  see  [4]. 
Below  we  give  an  estimate  of  the  error  || /  -  *(/)||  in  terms  of  ||/||i  and  other 
parameters  associated  with  the  Cs  and  4>’s. 


2.5  A  general  error  estimate. 


Recall  that  if  /  is  in  Hi  then  s(/)  is  the  orthogonal  projection  of  /  into  5,  the 
subspace  spanned  by  ti, ...  ,ln  in  Hi.  This  implies  that 

(18)  11/  -  *(/)ll?  =  ll/ll?  -  ll-(/)ll? 

whenever  /  is  regarded  as  an  element  of  Hi . 

The  following  proposition  gives  an  estimate  of  the  error  in  the  H  norm. 

Proposition  3  Suppose  the  matrix  M  defined  bp  (1)  is  invertible,  the  sequence 
{hj}  is  bounded,  and  /  is  in  H\.  Then 

(19)  ll/-*(/)l|<<ll/Hi 


where 


i  <  max  { \/hj  }  +  p 


[t  £  l4Wi)l»0 

\*=l;=n+l  / 


1/2 


and  p  is  the  spectral  radius  of  M~l. 
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Proof  First  observe  that  it  suffices  to  prove  the  proposition  in  the  case 

(20)  M/)  =  °. 

For  if  the  result  holds  in  this  case  then  in  the  general  case,  since  ik(f  —  «(/))  =  0 
for  all  k  and  «(/  —  s(f))  =  0,  we  may  write 

(21)  ll/-«(/)ll<e|l/-«(/)lli. 

Inequality  (21)  together  with  the  fact  that  ||/  — s(/)||i  <  ||/||i  imply  the  desired 
result. 

Now  suppose  that  /  satisfies  (20).  In  other  words 
00 

=  0  ,  k  =  1 . n 

j=l 

or  m 

(22)  ^ (&)/»  =  ~  ^  i  l,...,n. 

i=i 

If  we  denote  the  right  hand  side  of  (22)  by  y*,  set  y  =  (yi, . . . ,  yn)T ,  and  set 
x  =  (fi,...,fn)T  then  (22)  may  be  rewritten  as 

(23)  Mx  -  y 
From  (23)  it  follows  that 

(24)  |*|2  =  | M~ly\7  <  p'\y |2 

where  |x|J  denotes  the  sum  of  the  squares  of  the  components  of  x  and  p  is  the 
spectral  radius  of  M-1.  An  application  of  the  Schwartz  inequality  gives 

ivi3<e((i:  i/iivUf  iwW)} 

*=1  (  V=n+i  /  \;=n+l  /  J 

and  since  term  in  the  first  set  of  parentheses  is  dominated  by  ||/Uf  we  may  write 


-i2<  (E  £  iw/)i2m  ii/ii?- 


Finally 


(26)  £  l/,|2  <  .max  (W  £  <  max  {h>}||/||2. 

>=*»+ 1  ;=n+l 

Since 

(27)  ll/l!2  =  D/il2+  £  i/il3 

>=1  ;=n+l 

the  desired  result  follows  from  (27)  together  with  (24),  (25),  and  (26). 
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3  Examples. 

3.1  Point  evaluation  functionals. 

Suppose  that  the  ambient  space  W  is  a  collection  of  functions  defined  on  some 
set  12.  If*  is  an  element  of  {2  then  the  point  evaluation  functional  tx  is  defined 
by  ix(f)  =  f(x)  and  generally  makes  sense  for  some,  but  not  necessarily  all,  /  in 
W.  In  many  such  instances  there  are  readily  available  collections  of  functions, 
4>u  fa, . . .  ,  which  are  orthonormal  with  respect  to  appropriate  scalar  products 
{^, r!>)  and  for  which  t-x{4>j)  is  well  defined,  for  all  j.  Whenever  this  the  case  one 
can  take  %  to  be  the  Hilbert  space  generated  by  such  a  sequence.  One  can  then 
follow  the  procedure  outlined  in  subsection  2.2  to  obtain  a  Hilbert  space  Hi  on 
which  tx  is  a  continuous  linear  functional. 

If  Hi  is  such  that  tx  is  continuous  for  all  x  in  £2  then  it  is  a  reproducing 
kernel  Hilbert  space.  The  theory  of  such  spaces  is  well  documented  and  has 
found  wide  application;  a  detailed  account  of  the  basic  theory  may  be  found 
in  [2],  examples  and  various  applications  may  be  found  in  [3],  [4],  [6],  and  the 
references  cited  there.  In  our  setup  the  reproducing  kernel  K  is  given  by 

(28)  *(x.y)  =  f>;4(*3W;)- 

;=i 

The  variational  ♦ber  y  of  splines  may  be  viewed  in  some  sense  as  an  ap¬ 
plication  of  the  theory  of  reproducing  kernel  Hilbert  spaces.  Cardinal  splines 
are  a  nice  examp  'e  of  the  use  of  the  biorthogonal  representation  in  this  case, 
for  instance  see  [1],  A  comparison  of  the  univariate  polynomial  B-splines  with 
the  corresponding  cardinal  splines  also  shows  how  other  representations  can  be 
considerably  more  convenient  in  certain  applications. 


3.2  Seismic  borehole  tomography. 

Borehole  tomography  plays  a  significant  role  in  seismic  image  reconstuction. 
The  linearized  well  to  well  model  is  particulary  popular,  for  example,  see  [5] 
and  [7].  The  general  setup  may  be  described  as  follows: 

The  ambient  space  W  of  phantoms  /  can  initially  be  taken  to  be  the  class 
of  functions,  /(x,  y),  which  are  Lebesgue  measurable  on 

12  =  {(x,y)  :  0  <  x  <  a,  0  <  y  <  6}, 


where  a  and  6  are  fixed  positive  numbers.  The  linear  functionals  are  averages 
along  straigth  lines  between  points  on  opposite  vertical  boundaries  of  12. 

More  precisely,  let 


(29) 


x(t)  =  lit 

y(t)  =  vt  +  yo 
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be  the  parametric  representation  of  the  line  from  (0,  j/0)  to  (a,y i);  here  c  = 
Vi  ~  »o> 

r  =  s/a1  +  c2, 

u  =  a/r,  v  =  c/r,  and  t  is  the  arclength  parameter,  0  <  t  <  r.  The  cor¬ 
responding  linear  functional  (,  evaluated  at  a  feasable  phantom  /,  is  defined 

b’r  r 

(30)  ‘(f)  =  /  /(*(<),  v(t))dt 

Jo 

where  x(<)  and  y(t)  are  given  by  (29)  and  the  integration  is  taken  with  respect 
to  the  one  dimensional  Lebesgue  measure  dt. 

Note  that  t  is  not  defined  on  all  of  W,  namely,  ((f)  is  defined  only  for  those 
phantoms  /  for  which  the  right  hand  side  of  (30)  makes  sense.  Indeed,  if  we 
take  H  =  L2(Q),  the  class  of  function  which  are  square  integrable  with  respect 
to  Lebesgue  measure  on  Q  and  with  the  usual  scalar  product,  then  ((f)  is  not 
defined  even  for  all  such  /. 

The  mathematical  problem  of  well  to  well  tomography  then  is  to  approximate 
/  from  a  collection  of  averages  ((f)  corresponding  to  different  pairs  of  endpoints 
(0,yo)  and  (a,yi). 

Physically  the  quantity  ((f)  represents  the  travel  time  of  a  signal,  which 
may  be  acoustic,  between  the  coordinates  (0,yo)  and  (a,  yi).  The  phantom 
/  represents  the  ‘slowness’  profile  of  a  cross  section  of  the  earth,  represented 
by  fi,  between  two  bore  holes,  represented  by  the  vertical  boundary  lines  of 
U.  For  more  details  concerning  the  physical  interpretation  of  this  setup  see 
the  references  cited  above;  in  particular  [7]  gives  several  examples  of  different 
geometries  used  for  data  collection. 

For  the  sake  of  definiteness  we  confine  our  attention  to  a  specific  geometry  for 
data  collection.  The  reader  should  have  no  difficulty  in  making  the  appropriate 
adjustments  for  other  typical  geometries. 

The  geometry  we  will  consider  is  the  following:  Take 

Zi  =  - - £&  ,  i  =  1,  ...m, 

m 

and  let  £y  be  the  linear  functional  defined  by  (30)  with  yo  =  z,  and  yx  =  Zj, 
i,j  =  1  ,...,m.  (It  should  be  clear  that  in  this  case  it  is  natural  to  index  the 
functionals  with  multi-indicies.)  The  problem  then  is  to  find  an  estimator,  /, 
using  the  data  (ij(f),  i,j  =  1  In  the  notation  of  section  2  note  that 

n  =  mJ  and  the  values  of  n  functionals  of  the  phantom  /  are  known.  Clearly 
these  functionals  are  linearly  independent. 

It  is  well  known  that  this  problem  is  notoriously  ill-posed.  For  example,  it 
is  quite  apparent  that  any  two  phantoms  whose  difference  is  a  function  g  which 
depends  only  on  the  x  variable  and  is  odd  on  the  interval  0  <  x  <  a,  (namely, 
g(a  —  x)  =  —  y(x) )  cannot  be  distiquished  from  the  data. 
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Nevertheless,  because  of  the  significance  of  this  problem,  various  solution 
techniques  are  employed  to  obtain  estimators.  A  popular  technique  is  the  so- 
called  series  expansion  method;  this  is  essentially  simple  interpolation  described 
in  subsection  2.2.  The  most  common  choice  of  basis  functions  seems  to  be  the 
set  4>ij,  i,  j  =  1, . . . , m,  also  doubly  indexed  for  convenience  and  defined  by 


(31) 


if  <  z  <  and  ^-b  <  y  <  j-b 

m  —  m  m  —  m 

otherwise. 


The  reason  for  this  choice  appears  to  be  the  pixel-like  nature  of  such  a  basis. 
Unfortunately  the  corresponding  matrix  M,  see  formulas  (1),  (3),  and  (4)  in 
subsection  2.1,  is  not  invertible.  For  example,  in  the  case  m  =  20  the  number 
of  degrees  of  freedom  is  n  =  400  but  the  corresponding  400  x  400  matrix  M  has 
only  rank  344.  However  the  least  squares  solution  of  minimun  norm  of  (4)  can 
be  found  and  the  resulting  estimator  (3)  calculated.  Apparently  such  estimators 
seem  to  give  acceptable  results  in  many  instances. 

On  the  other  hand,  since  the  functionals  lij  are  linearly  independent,  the 
method  of  subsection  2.2  will  at  the  very  least  result  in  estimators  all  of  whose 
n  degrees  of  freedom  are  constrained  by  the  data. 

A  fairly  natural  choice  of  H  in  this  case  seems  to  be  H  =  L2(ii).  There  are 
many  well  known  complete  orthonormal  sequences  in  this  space  which  one  can 
utilize  to  apply  the  procedure  of  subsection  2.2.  For  example,  a  sequence  on 
which  one  can  easily  evaluate  the  functionals  under  consideration  in  closed  form 
is  given  by 

<32>  *"<■•»> ■*■'='’ . 

where 

il>o(z)  =  1  and  ^*(z)  =  \/2cos (fcxz),  k  =  1, . . .  . 

In  the  case  both  k  and  /  are  greater  than  zero  4>ki  may  be  expressed  as 


4>ki(x,y) 


+  cos  ir 


which  is  useful  for  evaluating  (30)  in  closed  form.  Since  the  final  expressions  are 
rather  cumbersome  and  calculation  tedious  but  straightforward,  we  leave  the 
explicit  evaluation  of  (30)  as  an  exercise  for  the  interested  reader. 

Possible  choices  of  s  which  will  guarantee  that  the  series 

OO  00 

£Dm*«)I3a« 

*=0  1=0 

converges  and  the  corresponding  matrix  L  defined  in  subsection  2.2  is  not  sin¬ 
gular  are 

(33)  h»,  =  (l+*’  +  !V‘ 
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where  e  is  a  positive  constant  and 


(34) 


|  1  if  0  <  k  <  n2  and  0  <  /  <  n2 
\  0  otherwise. 


We  emphasis  that  in  addition  to  the  <f>’s  given  by  (32)  there  are  many  other 
possibilities.  Currently  I.  Koltracht  and  the  author  are  conducting  numerical 
experiments  in  order  to  obtain  quantitative  comparisons  of  the  estimators  arising 
from  this  procedure  with  those  arising  from  conventional  methods.  The  results 
of  these  experiments  will  be  reported  on  elsewhere. 
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Translation  Invariant  Multiscale  Analysis 


W.  R.  Madych* 


Abstract 

The  notion  of  multiscale  analysis  introduced  by  R.  R.  Coifman  and 
Y.  Meyer  is  considered  and  the  translation  invariant  case  is  character¬ 
ized. 

1  Introduction 

Recall  that  a  dyadic  multiscale  analysis  of  L2(Rn)  is  an  increasing  sequence 
V  =  {Vj  :  j  =  . . . ,  —1, 0, 1,2, . . .}  of  closed  subspaces  of  L2(Rn)  which  has 
the  following  properties: 

(1) .  U£-oo  Vj  is  dense  in  L2(Rn)  and  f)~_«  Vj  =  {0}. 

(2) .  /( i)  is  in  Vj  if  and  only  if  f(2x )  is  in  Vj+u 

(3) .  There  is  a  lattice  T  in  Rn  such  that  for  every  /  in  V0  and  every  7  in  T 

the  function  is  in  Vo-  Here  and  in  what  follows  we  use  the  notation 

/»(*)  =  fix  ~  7 )• 

(4) .  There  are  two  positive  constants  C2  >  C\  >  0  and  a  function  g  in  V0 

such  that  Vo  is  the  closed  linear  span  of  gy,  7  G  T,  and 
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An  introduction  to  the  subject  may  be  found  in  [1,2].  A  basic  property 
of  a  multiscale  analysis  V  is  the  following: 

(5).  There  is  a  function  <j>  in  V0  such  that  the  collection  {<^,}.y€r  is  an  or¬ 
thonormal  basis  in  V0. 

This  fact  may  be  regarded  as  a  substitute  for  (4)  and  plays  an  important  role 
in  what  follows. 

A  dyadic  multiscale  analysis  is  translation  invariant  if  all  the  translates 
of  /,  {/„  :  y  €  Rn),  are  in  Vo  whenever  /  is  in  Vo. 

The  canonical  example  of  a  translation  invariant  multiscale  analysis  of 
i’(fl)  is  when  Vo  is  the  collection  of  those  functions  in  L?{R)  whose  Fourier 
transforms  are  supported  in  the  interval  [ — 7r,  tt].  A  natural  choice  of  <f>  in 
this  case  is  given  by 

x 

The  point  of  this  paper  is  to  give  a  characterization  of  translation  in¬ 
variant  multiscale  analyses.  For  the  sake  of  clarity  in  what  follows  we  will 
restrict  our  attention  to  the  case  n  =  1  and  V  —  Z,  the  lattice  of  integers. 
The  statements  and  arguments  in  the  general  case  are  completely  analogous 
to  this  basic  case. 

We  now  briefly  digress  to  list  some  of  the  conventions  which  are  used 
here:  The  Fourier  transform  /  of  a  function  /  is  defined  by 

m  =  -L  f°°  «"“'/(*)<(* 

v2jt  J-oo 

whenever  it  makes  sense  and  distributionally  otherwise.  Basic  facts  con¬ 
cerning  Fourier  transforms  and  distribi  tions  will  be  used  without  further 
elaboration  in  what  follows.  To  avoid  the  pedantic  repetition  of  “almost 
everywhere”  and  other  modifying  phrases  which  are  inevitably  necessary 
when  dealing  with  functions  defined  almost  everywhere,  all  equalities  be¬ 
tween  functions  and  other  related  notions  are  interpreted  in  the  distribu¬ 
tional  sense  whenever  possible.  The  term  support  is  also  used  in  the  dis¬ 
tributional  sense;  in  particular  the  support  of  a  function  /  in  L2(R)  is  a 
well  defined  closed  set.  If  W  is  a  collection  of  tempered  distributions  then 
W  is  the  collection  of  Fourier  transforms  of  elements  of  W,  in  other  words 
W  =  {/  :  f  =  g  for  some  g  in  W}.  For  a  subset  ft  of  R  and  a  real  number 


sinTrx 

7TX 
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r  the  sets  rft  and  ft  +  r  are  defined  by  rft  =  {i  :  x  =  rui  for  some  u>  in  ft} 
and  ft  -f  r  =  {x  :  x  =  u  +  r  for  some  ui  in  ft};  L2(Cl)  is  the  L 2  closure  of  the 
subspace  of  those  functions  in  L2(R)  whose  support  is  contained  in  Cl.  For 
notational  simplicity  we  use  Q  to  denote  the  closed  interval  [ — 7r,  *]. 

We  can  now  conveniently  state  our  main  observation. 

Theorem  Suppose  V  is  a  translation  invariant  dyadic  multiscale  analysis 
of  L2(R).  Then  Vo  =  L2(Cl)  where  Cl  is  a  closed  subset  of  R  which  has  the 
following  properties: 

(a) .  Cl  C  2ft. 

(b) .  {ft  +  2 irj]  H{ft  +  2t rk}  is  a  set  of  Lebesgue  measure  0  for  any  pair  of 

integers  such  that  j  ^  k. 

(c) .  UT=-oo{fi  +  2^}  =  JR. 

(d) .  \J?=l  L2(2kCl)  is  dense  in  L2(R). 

Conversely,  ifVk,  k  €  Z  is  defined  byVk  =  L2(2kCl)  where  Cl  is  a  closed  subset 
of  R  which  satisfies  the  properties  above  then  the  sequence  of  subspaces  {14} 
is  a  translation  invariant  multiscale  analysis  of  L2(R). 

Remark  1  In  view  of  the  example  given  above  it  is  very  tempting  to  con¬ 
jecture  that  the  set  ft  in  the  Theorem  must  be  of  the  form  ft  =  Q  -f  a  for 
some  real  number  a  which  satisfies  it  <  a  <  x.  Certainly  such  ft’s  satisfy 
the  desired  conditions.  However  the  conditions  of  the  Theorem  are  satisfied 
by  ft’s  which  need  not  be  connected  as  the  following  example  due  to  Rudi 
Lorentz  shows. 

H-tH u Hr x]u hr]  • 

Remark  2  Consider 

fl«  =  [-l,l]U[2*  +  I,4jr-l] 
ft*  =  [-5,5] 
fie  =  [-1,1] 
ft*  =  [0,2*]. 
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It  is  not  difficult  to  verify  that  each  fla  listed  above  is  a  closed  set  which 
fails  to  satisfy  condition  (a)  but  satisfies  the  remaining  conditions  in  the 
Theorem.  These  examples  show  that  conditions  (a)-(d)  are  not  redundant. 

Remark  3  Note  that  condition  (a)  implies  that  0  is  contained  in  Cl.  In 
addition  to  this  it  is  clear  that  if  fl  contains  a  neighborhood  of  the  origin 
then  it  satisfies  condition  (d).  In  view  of  this  it  seems  reasonable  to  suspect 
that  subsets  Cl  which  satisfy  the  conditions  of  the  Theorem  must  contain  an 
open  neighborhood  of  the  origin.  That  this  is  not  the  case  can  be  seen  by 
considering  the  following  example  of  Cl: 

l  U  (-(2  -  r*)2-‘r,  -2-**]}  (J[0,  *]{  0  IP  ~  (2  -  2"‘)2-*)ir,  (2  -  2‘‘)»)}  . 

k=l  k= 1 

Remark  4  In  view  of  the  examples  listed  above  it  may  be  of  some  interest 
to  obtain  a  significantly  more  lucid  description  of  the  set  fl  than  that  given 
in  the  Theorem. 

A  corollary  concerning  wavelets  generated  by  V  is  recorded  at  the  end  of 
Section  2. 


2  Details 


We  begin  by  establishing  a  basic  lemma.  First  recall  that  the  indicator 
function  of  a  set  fl  is  usually  denoted  by  xn  and  satisfies 


Xntf)  = 


{ 


i  if  {  e  fi 

0  otherwise. 


Lemma  Suppose  V  is  a  translation  invariant  dyadic  multiscale  analysis  of 
L2(R)  and  <f>  is  a  function  whose  existence  is  guaranteed  by  (5).  Then 

M  =  Xn 


where  \o  is  the  indicator  function  of  a  closed  set  Cl  which  has  properties 
(a)-(d)  in  the  statement  of  the  Theorem. 

Let  fl  be  the  support  of  4>.  To  prove  the  lemma  we  will  first  show  that  fl 
satisfies  property  (b). 
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(6) 


Recall  that  (5)  implies  that  for  all  /  in  VJ,  we  may  write 

/(o  = 

where  g  is  2 w  periodic  and  square  integrable  over  Q.  In  particular,  since  V0 
is  translation  invariant,  <f>y  is  in  Vo  so  setting  a  —  —  y  we  may  write 

eiaim  =  g(om 


for  some  such  g.  Hence 

2*m)<£(£  —  27rm)  =  g(£  —  2?r  —  27rm)  =  g(()<f>{£  —  2irm) 

which  implies  that 

eia(i-Um)  _ 

on  ft  +  2n m.  For  two  different  values  of  m  the  last  equality  implies  that 

eiatf-2rj)  _  e»or(£-2»fc) 

on  {ft  +  2irj]  H{fi  +  2 irk}.  Re-expressing  the  last  relation  as 

eio.(£-2irfc)^e«2iror(fc-j)  _  _  Q 

it  is  clear  that  either  a  is  an  integer,  j  is  equal  to  k,  or  {ft-F27rj}  n{0  +  27rfc} 
is  a  set  of  measure  zero.  Since  a  may  be  any  real  number  we  conclude  that 
{ft  +  2irj}  f){ft  +  27rfc}  has  measure  zero  whenever  j  /  k. 

Now,  since  <f>k{0  =  &  €  Z,  are  orthonormal,  we  may  write 

(7)  Jr  =  JR  eim*m)\2dt  = 

/,«** 

where  m  =  (  —  k.  The  last  equality  implies  that 

Y  -  2*»|2  = 
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on  R  and  since  {fi  +  2irj}  fl{^  +  2irk}  has  measure  zero  whenever  j  ^  k  we 
may  conclude  that 

*0'  - 

and 

U{ft  +  2?rA:}  =  R  . 
kez 

To  see  (a)  observe  that  (2)  and  the  facts  demonstrated  above  imply  that 

Xo(0  =  Ht)Xa(m 

where  h  is  4t  periodic  and  square  integrable  over  2 Q.  Since  xmtf)  = 
Xn(f/2),  the  last  equality  involving  h  implies  that  xa  vanishes  whenever 
*20  does  so  C  2(1. 

Finally,  the  fact  that  U*li  L2(2k(l)  is  dense  in  L2(R)  is  an  immediate 
consequence  of  property  (1).  The  proof  of  the  Lemma  is  complete. 

Now,  suppose  <f>  and  (l  are  as  in  the  Lemma  and  its  proof.  Since  V0 
consists  of  functions  /  which  satisfy  (6)  it  is  clear  that  VQ  is  contained  in 
L2((l). 

To  see  that  V0  =  L2((l)  let  /  be  any  element  in  L2{(1)  and  let  h  be  defined 

by  _ 

=  ( ^(o/itoi  if  ttt)  £  0 

l  0  otherwise. 

By  virtue  of  the  properties  of  (l  established  above  it  is  clear  that 


and 

m  =  g(om 

where 

g{{)  =  -  27r;)j  &({  -  2*/)j  . 

Thus  /  satisfies  (6)  and  hence  we  may  conclude  that  L2(Cl)  is  contained  in 
Vo- 
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The  Lemma  together  with  the  last  observation  imply  the  first  assertion 
of  the  Theorem. 

To  see  the  converse,  let  V  be  the  sequence  of  subspaces  {\4},  k  E  Z, 
defined  by  V*  =  L2(2kCl)  where  Q  is  a  closed  set  which  satisfies  properties 
(a)-(d)  of  the  Theorem. 

The  fact  that  V  is  translation  invariant  and,  in  particular,  satisfies  prop¬ 
erty  (3)  with  T  =  Z  is  an  immediate  consequence  of  the  definition.  Property 
(2)  is  also  immediate.  That  V  is  an  increasing  sequence  of  subspaces  and 
U kez  V*  is  dense  in  L2(R)  are  consequences  of  properties  (a)  and  (d). 

That  fW  14  =  {0}  follows  from  the  fact  that  the  measure  of  f l  is  finite. 
Indeed,  its  measure  is  2ir  which  can  be  seen  from 

fxaiOdt  =  52  I  xait)dt  =  f  £  XnU  ~  2 *j)d{  =  2tt 
Jr  jezJQ+ JQftz 

by  using  properties  (b)  and  (c). 

Finally,  to  see  property  (5)  take 

and  use  properties  (b)  and  (c)  to  write  (7)  which  shows  that  k  E  Z, 

are  orthonormal  and,  for  /  in  Vo, 

or 

/(*)  =  52  f(j)<Kx  - k ) 

which  shows  that  they  are  complete  in  V0. 

This  completes  the  proof  of  the  Theorem. 

Remark  5  Suppose  V  is  a  translation  invariant  multiscale  analysis  and  Cl  is 
a  closed  set  such  that  Vo  =  L3(Cl).  Then  if  W0  is  the  orthogonal  complement 
of  Vo  in  Vj,  W0  =  i2(T)  where  T  =  2fl  \  Cl.  Let  ip  be  such  that  the  set 
{ipk  '■  k  E  Z}  is  an  orthonormal  basis  for  W0.  Such  a  ip  may  be  referred  to 
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as  a  wavelet.  Using  reasoning  analogous  to  the  proof  of  the  Theorem,  it  is 
clear  that  ip  is  a  wavelet  if  and  only  if 

^  =  ■ 

Now,  an  analyzing  wavelet  in  the  sense  of  Meyer,  [1],  is  globally  integrable 
and  hence  its  Fourier  Transform  must  be  continuous.  Clearly  ip  is  not  such 
an  analyzing  wavelet. 

Corollary  A  translation  invariant  multiscale  analysis  cannot  give  rise  to 
analyzing  wavelets  in  the  sense  of  Meyer. 
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